Scrapy, a fast high-level web crawling & scraping framework for Python.
Security bug fixes.
from_crawler
methods, e.g. based on spider arguments.Marked Twisted >= 23.8.0
as unsupported.
This is a maintenance release, with minor features, bug fixes, and cleanups.
Proxy-Authentication
header can again be set explicitly in certain cases, restoring compatibility with scrapy-zyte-smartproxy 2.1.0 and olderMakes pip install Scrapy
work again.
It required making changes to support pyOpenSSL 22.1.0. We had to drop support for SSLv3 as a result.
We also upgraded the minimum versions of some dependencies.
See the changelog.