Introducing ScrapyRT: An API for Scrapy spiders (opens in new tab)

We’re proud to announce our new open source project, ScrapyRT! ScrapyRT, short for Scrapy Real Time, allows you to extract data from a single web page via an API using your existing Scrapy spiders. Why did we start this project? We needed to be able to retrieve the latest data for a previously scraped page, […]