spideymooon / McOracle
不要问 AI，问薯条。一个结合麦当劳 MCP 与 AI 答案之书的 Skill。
spideymooon / McOracle
cv-cat / DouYin_Spider
抖音逆向，抖音爬虫，抖音全部api、私信、直播间监听
cv-cat / catbus
一个命令操作小红书、抖音、TikTok、B 站、快手、微博、闲鱼、淘宝、京东、X：统一的命令与 JSON 输出，给人和 AI Agent 用
toowasmir / WebOfShadowsRecomp
Unofficial native Windows x64 PC port of Spider-Man: Web of Shadows (Xbox 360) created through static recompilation. No game assets included.
cv-cat / Spider_XHS
小红书爬虫数据采集，小红书逆向，私信，直播，小红书全域运营解决方案
DedSecInside / TorBot
Dark Web OSINT Tool
Silent1566 / OmniBox-Spider
—
FongMi / CatVodSpider
—
BBCPrince / UWP-Spider-Launcher
Experimental Xbox UWP launcher with USB and Wi-Fi imports, Steam downloads, and on-device preparation from your own game files.
projectdiscovery / katana
A next-generation crawling and spidering framework.
amirh00sain / SpiderPanel
—
WhiteNightShadow / firefox-reverse
🦊 内置 AI 逆向 Agent 的 Firefox — 通用 JS/JSVMP/WASM/签名逆向工作站，SpiderMonkey 引擎层非侵入 trace，把加密参数从黑盒还原成不依赖浏览器的纯算法
facebookresearch / spider
A general physic-based retargeting framework.
h100envy / gem-search
Rainbow spider that X-rays memecoins: bundles, linked wallets, dev history. Scanner, Telegram bot, live Bundle Index.
NaiboWang / EasySpider
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
gocolly / colly
Elegant Scraper and Crawler Framework for Golang
wechatsync / Wechatsync
一键同步文章到多个内容平台，支持今日头条、WordPress、知乎、简书、掘金、CSDN、typecho各大平台，一次发布，多平台同步发布。解放个人生产力
spider-rs / spider
Foundational low latency web data collecting in Rust
zorlan / skycaiji
蓝天采集器是一款开源免费的爬虫系统，仅需点选编辑规则即可采集数据，可运行在本地、虚拟主机或云服务器中，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统
eatmoreduck / boss-zhipin-scraper
Boss直聘爬虫 / BOSS直聘职位数据抓取工具，基于 Chrome CDP 协议复用真实登录态，绕过字体反爬，输出明文薪资 JSON/CSV + 薪资技能分析。A Chrome-CDP-based BOSS Zhipin job scraper/crawler.
alltheplaces / alltheplaces
A set of spiders and scrapers to extract location information from places that post their location on the internet.
IlyaMez / SpidyVR
—
GenryTheFox0 / Project-2099
Unofficial Windows recompilation of Spider-Man: Edge of Time with PC controls, settings, localization, achievements and mod support.
GTTeancum / SpideyPS1recomp
Native recompilations of Neversoft's PlayStation Spider-Man games, built with RecompOne. Games are siloed; only the recompiler and runtime are shared.
wistbean / learn_python3_spider
python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifulSoup、selenium、appium、scrapy等，以及IP代理，验证码识别，Mysql，MongoDB数据库的python使用，多线程多进程爬虫的使用，css 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等
s0md3v / Photon
Incredibly fast crawler designed for OSINT.
scrapy / scrapyd
A service daemon to run Scrapy spiders
howie6879 / owllook
owllook-小说搜索引擎
jae-jae / QueryList
:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
JayBizzle / Crawler-Detect
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
ShunCai / QZoneExport
QQ空间导出助手，用于备份QQ空间的说说、日志、私密日记、相册、视频、留言板、QQ好友、收藏夹、分享、最近访客为文件，便于迁移与保存
coder-hxl / x-crawl
Flexible Node.js crawler library
howie6879 / ruia
Async Python 3.6+ web scraping micro-framework based on asyncio
Spiderpig86 / Cirrus
:cloud: The SCSS framework for the modern web.
blacklanternsecurity / MANSPIDER
Spider entire networks for juicy files sitting on SMB shares. Search filenames or file content - regex supported!
monperrus / crawler-user-agents
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
okfn-brasil / querido-diario
📰 Diários oficiais brasileiros acessíveis a todos | 📰 Brazilian government gazettes, accessible to everyone.
omrilotan / isbot
🤖/👨🦰 Detect bots/crawlers/spiders using the user agent string
scrapfly / scrapfly-scrapers
Scalable Python web scraping scripts for +40 popular domains
Distributive-Network / PythonMonkey
A Mozilla SpiderMonkey JavaScript engine embedded into the Python VM, using the Python engine to provide the JS host environment.
fredwu / crawler
A high performance web crawler / scraper in Elixir.
jasoneri / ComicGUISpider
漫画下载软件：拷贝漫画, Māngabz, jestful, 漫画柜, 动漫屋, 禁漫天堂, wnacg, exhentai, nhentai, hitomi.la, h-comic ; 附有 kemono, danbooru 等衍生下载工具
0xAllenChen / spider_reverse
爬虫逆向案例，已完成：TLS指纹｜瑞数｜震坤行 | 网易易盾 | 微信小程序反编译逆向(百达星系) | 同花顺 | rpc解密 | 加速乐 | 极验滑块验证码 | 巨量算数 | Boss直聘 | 企查查 | 中国五矿 | qq音乐 | 产业政策大数据平台 | 企知道 | 雪球网(acw_sc__v2) | 1688 | 七麦数据 | whggzy | 企名科技 | mohurd | 艺恩数据 | 欧科云链
TheCymaera / minecraft-spider
—
scrapinghub / scrapyrt
HTTP API for Scrapy spiders
synopse / mORMot
Synopse mORMot 1 ORM/SOA/MVC framework - Please upgrade to mORMot 2 !
BlessedRebuS / Krawl
Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realistic, randomly generated decoy data and AI-generated HTML templates.
SelmiAbderrahim / rankme.fast
The self-hosted SEO platform.
polyrabbit / hacker-news-digest
:newspaper: Let LLM Summarize Hacker News for You
montaro2017 / bili_novel_packer
轻小说打包器，采集哔哩轻小说网站(bilinovel.com linovelib.com)内容，打包成EPUB格式，支持封面、插图、目录，支持分卷合并。
signal18 / replication-manager
Signal 18 repman - Replication Manager for MySQL / MariaDB / Percona Server
yeximm / Access_wechat_article
微信文章爬虫，用于采集、整理和归档微信公众号公开文章元数据，欢迎一起学习讨论。A Windows research workbench for collecting, organizing, and archiving public WeChat article metadata.
pagopa / io-app
IO, l'app dei servizi pubblici
spidernet-io / spiderpool
Underlay and RDMA network solution of the Kubernetes, for bare metal, VM and any public cloud
scrapfly / Antibot-Detector
Real-time detection of anti-bot systems, captchas & fingerprinting techniques. Identifies Cloudflare, Akamai, DataDome, reCAPTCHA, hCaptcha, Shape Security & more with confidence scoring and advanced capture tools.
CharlesPikachu / freeproxy
FreeProxy: Collecting free proxies from internet. (全球海量高质量免费代理，支持爬取数十个免费代理分享源，支持自定义规则代理筛选，爬虫与数据分析必备，每日更新海量免费代理。)
scrapinghub / spidermon
Scrapy Extension for monitoring spiders execution.
xikhar / spiderbench
—
aspida / pathpida
TypeScript friendly internal link client for Next.js and Vinext.
aoyunyang / spider-king-skill
Protocol-first reverse engineering skill for turning hostile web clients into pure-protocol Python collectors.