A curated list of the most common and most interesting robots.txt disallowed directories.
No resources for this project.