All repos — GH Trending Explorer

原生 JavaScript + Canvas 2D 的机械蜘蛛可视化 UI。普通演示零依赖；可选 MCP 接入自己的 Agent，实时展示任务，支持三套布局、主题定制、JSON 回放与独立项目导出。 | Canvas spider UI with live Agent visualization via MCP.

toowasmir / WebOfShadowsRecomp

Unofficial native Windows x64 PC port of Spider-Man: Web of Shadows (Xbox 360) created through static recompilation. No game assets included.

NaiboWang / EasySpider

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。

gocolly / colly

Elegant Scraper and Crawler Framework for Golang

wistbean / learn_python3_spider

python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifulSoup、selenium、appium、scrapy等，以及IP代理，验证码识别，Mysql，MongoDB数据库的python使用，多线程多进程爬虫的使用，css 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等

projectdiscovery / katana

A next-generation crawling and spidering framework.

s0md3v / Photon

Incredibly fast crawler designed for OSINT.

cv-cat / Spider_XHS

小红书爬虫数据采集，小红书逆向，私信，直播，小红书全域运营解决方案

wechatsync / Wechatsync

一键同步文章到多个内容平台，支持今日头条、WordPress、知乎、简书、掘金、CSDN、typecho各大平台，一次发布，多平台同步发布。解放个人生产力

DedSecInside / TorBot

Dark Web OSINT Tool

cv-cat / DouYin_Spider

抖音逆向，抖音爬虫，抖音全部api、私信、直播间监听

scrapy / scrapyd

A service daemon to run Scrapy spiders

howie6879 / owllook

owllook-小说搜索引擎

spider-rs / spider

Foundational low latency web data collecting in Rust

jae-jae / QueryList

:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

JayBizzle / Crawler-Detect

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

zorlan / skycaiji

蓝天采集器是一款开源免费的爬虫系统，仅需点选编辑规则即可采集数据，可运行在本地、虚拟主机或云服务器中，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统

amirh00sain / SpiderPanel

—

ShunCai / QZoneExport

QQ空间导出助手，用于备份QQ空间的说说、日志、私密日记、相册、视频、留言板、QQ好友、收藏夹、分享、最近访客为文件，便于迁移与保存

coder-hxl / x-crawl

Flexible Node.js crawler library

howie6879 / ruia

Async Python 3.6+ web scraping micro-framework based on asyncio

eatmoreduck / boss-zhipin-scraper

Boss直聘爬虫 / BOSS直聘职位数据抓取工具，基于 Chrome CDP 协议复用真实登录态，绕过字体反爬，输出明文薪资 JSON/CSV + 薪资技能分析。A Chrome-CDP-based BOSS Zhipin job scraper/crawler.

Spiderpig86 / Cirrus

:cloud: The SCSS framework for the modern web.

blacklanternsecurity / MANSPIDER

Spider entire networks for juicy files sitting on SMB shares. Search filenames or file content - regex supported!

monperrus / crawler-user-agents

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:

okfn-brasil / querido-diario

📰 Diários oficiais brasileiros acessíveis a todos | 📰 Brazilian government gazettes, accessible to everyone.

Silent1566 / OmniBox-Spider

—

omrilotan / isbot

🤖/👨‍🦰 Detect bots/crawlers/spiders using the user agent string

scrapfly / scrapfly-scrapers

Scalable Python web scraping scripts for +40 popular domains

Distributive-Network / PythonMonkey

A Mozilla SpiderMonkey JavaScript engine embedded into the Python VM, using the Python engine to provide the JS host environment.

fredwu / crawler

A high performance web crawler / scraper in Elixir.

jasoneri / ComicGUISpider

漫画下载软件：拷贝漫画, Māngabz, jestful, 漫画柜, 动漫屋, 禁漫天堂, wnacg, exhentai, nhentai, hitomi.la, h-comic ; 附有 kemono, danbooru 等衍生下载工具

0xAllenChen / spider_reverse

WhiteNightShadow / firefox-reverse

🦊 内置 AI 逆向 Agent 的 Firefox — 通用 JS/JSVMP/WASM/签名逆向工作站，SpiderMonkey 引擎层非侵入 trace，把加密参数从黑盒还原成不依赖浏览器的纯算法

FongMi / CatVodSpider

—

TheCymaera / minecraft-spider

—

scrapinghub / scrapyrt

HTTP API for Scrapy spiders

alltheplaces / alltheplaces

A set of spiders and scrapers to extract location information from places that post their location on the internet.

synopse / mORMot

Synopse mORMot 1 ORM/SOA/MVC framework - Please upgrade to mORMot 2 !

BlessedRebuS / Krawl

Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realistic, randomly generated decoy data and AI-generated HTML templates.

SelmiAbderrahim / rankme.fast

The self-hosted SEO platform.

polyrabbit / hacker-news-digest

:newspaper: Let LLM Summarize Hacker News for You

montaro2017 / bili_novel_packer

轻小说打包器，采集哔哩轻小说网站(bilinovel.com linovelib.com)内容，打包成EPUB格式，支持封面、插图、目录，支持分卷合并。

signal18 / replication-manager

Signal 18 repman - Replication Manager for MySQL / MariaDB / Percona Server

yeximm / Access_wechat_article

微信文章爬虫，用于采集、整理和归档微信公众号公开文章元数据，欢迎一起学习讨论。A Windows research workbench for collecting, organizing, and archiving public WeChat article metadata.

spidernet-io / spiderpool

Underlay and RDMA network solution of the Kubernetes, for bare metal, VM and any public cloud

facebookresearch / spider

A general physic-based retargeting framework.

CharlesPikachu / freeproxy

FreeProxy: Collecting free proxies from internet. (全球海量高质量免费代理，支持爬取数十个免费代理分享源，支持自定义规则代理筛选，爬虫与数据分析必备，每日更新海量免费代理。)

scrapinghub / spidermon

Scrapy Extension for monitoring spiders execution.

xikhar / spiderbench

—

aoyunyang / spider-king-skill

Protocol-first reverse engineering skill for turning hostile web clients into pure-protocol Python collectors.

cv-cat / catbus

一个命令操作小红书、抖音、TikTok、B 站、快手、微博、闲鱼、淘宝、京东、X：统一的命令与 JSON 输出，给人和 AI Agent 用

h100envy / gem-search

Rainbow spider that X-rays memecoins: bundles, linked wallets, dev history. Scanner, Telegram bot, live Bundle Index.

luki-1 / ArkWeb

Spider-Man Remastered's web swinging in Batman: Arkham Knight's Gotham (experimental mod)

midudev / spiderman-brand-new-day

Web oficial española para la película Spiderman Brand New Day

cv-cat / KuaiShou-Spider

快手逆向，快手爬虫，快手全部api、直播间监听

GenryTheFox0 / Project-2099

Unofficial Windows recompilation of Spider-Man: Edge of Time with PC controls, settings, localization, achievements and mod support.

abcbca111 / Spider-Sense-Trainer-Suite

Spider Man 2 Trainer Hub 2026 Safe Windows 11 Setup Guide and Boosts

Ouru77 / ev-assistant

🕸️ E.V. — Peter Parker's homemade AI from Spider-Man: Brand New Day, running locally on YOUR PC. Voice assistant + cyber HUD, real PC control, long-term memory. Whisper + Ollama, no cloud. TR/EN.

iltaen / spider_walker

Blender addon: Procedural walking for spider-like armatures