scrapy-poet documentationΒΆ

scrapy-poet easily integrates Page Objects created using web-poet with Scrapy through the configuration of a dependency injection middleware.

web-poet is used to make reusable Page Objects that separates extraction logic from crawling. They could be easily tested and distributed across different projects. Also, they could make use of different backends, for example, acquiring data from Splash and AutoExtract API.

The goal of this project is to provide a bridge between Scrapy Spiders and Page Objects.

Please, see also our Installation guide and our Tutorial for a quick start.

License is BSD 3-clause.