Creates an XML-Sitemap by crawling a given site.
Add more CLI options (#42)
maxConcurrency
and noRespectRobotsTxt
flags (thanks to @vinaymavi)Update dependencies. (Fixes link discovery bug)
Add --max-entries
and --max-depth
options. Thanks to @MarcosX
The second filepath argument is now optional. The value is by default sitemap.xml
. If you want to change the path or filename you can set it by using --filepath myfile.xml
.
Updated dependencies.
Update dependencies.
Update sitemap-generator (improves logging of local errors).
Update dependencies (fixes #23).