Pinned

1. scrapinghub/shublang scrapinghub/shublang Public

   Pluggable DSL that uses pipes to perform a series of linear transformations to extract data

   Python 15 8

2. scrapy-kafka scrapy-kafka Public

   Forked from dfdeshom/scrapy-kafka

   Kafka-based components for Scrapy

   Python 1

3. python-firebasin python-firebasin Public

   Forked from abeisgoat/python-firebasin

   Websocket client for Firebase

   Python

4. scrapy/parsel scrapy/parsel Public

   Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

   Python 1.1k 134

5. scrapy-crawlera-fetch scrapy-crawlera-fetch Public

   Forked from scrapy-plugins/scrapy-crawlera-fetch

   Scrapy Downloader Middleware for Crawlera Fetch API

   Python

6. scrapinghub/frontera scrapinghub/frontera Public

   A scalable frontier for web crawlers

   Python 1.3k 219