Crawler Versions Save

An easy to use, powerful crawler implemented in PHP. Can execute Javascript.

4.7.6

3 years ago

Add support for PHP 8

5.0.2

3 years ago
  • add support for PHP 8.0

5.0.1

3 years ago
  • tweak variable naming in ArrayCrawlQueue (#326)

5.0.0

3 years ago
  • improve chucked reading of response
  • move observer / profiles / queues to separate namespaces
  • typehint all the things
  • use laravel/collections instead of tightenco package
  • remove support for anything below PHP 7.4
  • remove all deprecated functions and classes

4.7.5

3 years ago
  • treat connection exceptions as request exceptions

4.7.4

3 years ago
  • fix: method and property name error (#311)

4.7.3

3 years ago
  • add crawler option to allow crawl links with rel="nofollow" (#310)

4.7.2

4 years ago
  • only crawl links that are completely parsed

4.7.1

4 years ago
  • fix curl streaming responses (#295)

4.7.0

4 years ago
  • add setParseableMimeTypes() (#293)