🎭 Playwright integration for Scrapy
A multi-thread crawler framework with many builtin image crawlers provided.
HTTP API for Scrapy spiders
Possibly the best practice of Scrapy ? and renting a house ?
豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpide...
Simple but useful Python web scraping tutorial code.
Two dumb distributed crawlers
Personal Data Engineering Projects
use multiple proxies with Scrapy
豆瓣电影/豆瓣读书 Scarpy 爬虫
Random User-Agent middleware based on fake-useragent
Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker an...
A Facebook crawler
收集各种免费的 Python 爬虫项目
基于 scrapy-redis 的通用分布式爬虫框架