Scrapy, a fast high-level web crawling & scraping framework for Python.
Elegant Scraper and Crawler Framework for Golang
News, full-text, and article metadata extraction in Python 3. Advanced d...
Distributed crawler powered by Headless Chrome
Declarative web scraping
Crawlee — The scalable web scraping and crawling library for JavaScript/...
Simple, fast web crawler designed for easy, quick discovery of endpoints...
A Devtools driver for web automation and scraping
Apache Nutch is an extensible and scalable web crawler
A curated list of awesome puppeteer resources.
蓝天采集器是一款免费的数据采集发布爬虫软件,采用php+mysql开发,可部署在...
[Unmaintained] A simple and clean video/music/image downloader 👾
HTTP API for Scrapy spiders
Scrapy middleware to handle javascript pages using selenium
Simple but useful Python web scraping tutorial code.