Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
This script automates the process of searching for a website via keyword
and the DuckDuckGo search engine.... page after page
Pass a complete URL and at least 1 keyword as command line arguments to run program:
python proxy_crawler.py -u
python proxy_crawler.py -u "https://www.whatsmyip.org" -k "my ip"
Add the -x option to run headless (no GUI):
python proxy_crawler.py -u "https://www.whatsmyip.org" -k "my ip" -x
pip install -r requirements.txt