Scrapy tips from the pros: February 2016 edition (opens in new tab)

Welcome to the February Edition of Scrapy Tips from the Pros. Each month we’ll release a few tips and hacks that we’ve developed to help make your Scrapy workflow go more smoothly. This month we’ll show you how to crawl websites more effectively following sitemaps and we'll also demonstrate how to add custom settings to […]