lc / gau

git clone https://github.com/lc/gau.git

Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl.