Canrevan Versions Save

Fixed

• The previous user-agent canrevan now does not work. As reported in #3, we changed the default user-agent string and added an option to configure your own custom user-agent string through --user-agent.

Changed

• We reformatted the entire codes with black and isort. Also we changed to lint the codes with flake8 strictly. The mentioned linting and format-checks will be done on push and pull-request events.

A minor update! Fix bugs in using aiohttp module.

A major update! Performance optimization.

Changed

• Change to use the semaphore in creating tasks instead of fetching tasks directly.

Remove unused dependencies

A minor update!

Fixed

• Change some methods in asyncio module for compatibility with Python 3.6.

A major update!

• Change the asynchronous crawling algorithm.
• Remove the Expanda extension. Now canrevan does not support Expanda.