alltheplaces / alltheplaces
A set of spiders and scrapers to extract location information from places that post their location on the internet.
alltheplaces / alltheplaces
JayBizzle / Crawler-Detect
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
scrapy / scrapyd
A service daemon to run Scrapy spiders
monperrus / crawler-user-agents
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
omrilotan / isbot
🤖/👨🦰 Detect bots/crawlers/spiders using the user agent string
scrapinghub / scrapyrt
HTTP API for Scrapy spiders
scrapinghub / spidermon
Scrapy Extension for monitoring spiders execution.
arcticspiderstore / yuzu-prime
Yuzu Prime