Scrapinghub

Scrapinghub provides users with a variety of web crawling and data processing services. Its APIs allow users to schedule scraping jobs, retrieve scraped items, retrieve the log for a job, retrieve information about spiders, and retrieve autoscraping project specifications in slybot format. The APIs also allow users to upload python eggs and to upload reports that are attached to a scraping job. The Scrapinghub APIs operate via REST calls in JSON or JSONP.