snooppr / snoop
Snoop — инструмент разведки на основе открытых данных (OSINT world)
snooppr / snoop
php-curl-class / php-curl-class
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
x4nth055 / pythoncode-tutorials
The Python Code Tutorials
brightdata / brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
saifyxpro / HeadlessX
The undetected self-hosted browser automation platform. Powered by Camoufox (Firefox) for 0% detection rates. Built for speed, privacy, and scalability.
microlinkhq / browserless
The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.
rushter / selectolax
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
gildas-lormeau / single-file-cli
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
orangecoding / fredy
❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, houses, and flats in Europe on platforms like ImmoScout24, Immowelt, eBay Kleinanzeigen and instantly delivers the results to you via Slack, Telegram, Email, Discord or ntfy, so you can focus on the more important things in life ;)
tidyverse / rvest
Simple web scraping for R
0x676e67 / wreq-python
An ergonomic, privacy-aware Python HTTP Client
austin-weeks / miasma
Trap AI web scrapers in an endless poison pit.
intoli / user-agents
A JavaScript library for generating random user agents with data that's updated daily.
juancarlospaco / faster-than-requests
Faster requests on Python 3
scrapfly / scrapfly-scrapers
Scalable Python web scraping scripts for +40 popular domains
Anil-matcha / awesome-agent-apis
660+ muapi-hosted generative-media models plus community-submitted third-party API tools (SEO, enrichment, social, scraping) — one YAML file per entry, browsable by capability.
germondai / trawl
Self-hosted scraping engine — bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr alternative and drop-in replacement for your *arr stack.
ovobrowsersupport / ovobrowser
源码级 Chromium 指纹内核，检测站按普通 Chrome 评分。Source-level Chromium fingerprint kernel that passes bot detection tests. Not JS injection — C++ patches compiled into the binary.
ail-project / ail-framework
AIL framework - Analysis Information Leak framework
runesleo / x-reader
Universal content reader MCP Server for 10+ platforms
oxylabs / agent-skills
Official Agent skills of Oxylabs products
ttlns / Selenium-Driverless
a stealthy browser automation framework
feder-cr / invisible_selenium
Selenium that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.
Kaliiiiiiiiii-Vinyzu / patchright-nodejs
Undetected NodeJS version of the Playwright testing and automation library.
figranium / figranium
Stack blocks visually to build complex browser workflows and execute them via API
tiliondev / fortress
Stealth Chromium engine that stops scrapers and browser agents from getting blocked, with one line of code change.
zhaotoday / fingerprint-browser
指纹浏览器（防关联浏览器 / 反检测浏览器 / Antidetect Browser）与住宅代理 IP 选型指南及开源资源汇总：整理 27 款主流指纹浏览器与 28 家代理 IP 的套餐价格，收录 Chromium 指纹定制、Camoufox、Patchright、反检测自动化与指纹检测工具。
1broseidon / ketch
Fast, stateless CLI for web search and scrape. Built for AI agents.
letr007 / CCTVVideoDownloader
一款适用于央视网的网络视频流解析处理工具
oxylabs / agent-browser
Execute complex automation scripts via remote cloud sessions , featuring integrated residential proxies , automated CAPTCHA solving , and native JavaScript rendering for the toughest dynamic websites.
scrapfly / Antibot-Detector
Real-time detection of anti-bot systems, captchas & fingerprinting techniques. Identifies Cloudflare, Akamai, DataDome, reCAPTCHA, hCaptcha, Shape Security & more with confidence scoring and advanced capture tools.
jaebradley / basketball_reference_web_scraper
NBA Stats API via Basketball Reference
only-cli / oc
Turn any website into a compact CLI tailored for AI agents. Browse the web in hundreds of tokens, not tens of thousands.
n1tr00-10 / tiktok-web-signature
tiktok web signature reverse engineer generates valid tiktok signatures for API requets
cporter202 / coreclaw-api-directory
An unofficial, categorized directory of 118 CoreClaw Worker APIs for web scraping, automation, lead generation, e-commerce, social data, and more.
woniu9524 / open-web-bridge
Drive your real Chrome from any AI agent — logged-in sessions, real fingerprint, live tabs. CLI-based, works with OpenCode, Pi, or any Harness.
cporter202 / ecommerce-intelligence-apis
A curated directory of ecommerce intelligence APIs for products, prices, reviews, sellers, and marketplaces.
proofofbots / web-re-toolkit
Headless Akamai & Kasada solver that runs without a browser, and the reversing toolkit it was built with
yail259 / frankensurf
One call that gets your agent through any site, stitched from 28 browsing tools
RayenMlayeh / jevcrawl
MCP server and CLI that crawls websites for AI agents: finds the answer page 2x more often than Crawl4AI, 10x cheaper per answer than letting Claude crawl.
Loecedas / InkGist
极简黑白水墨风 AI 网页智能速读与全功能多用户云端书签平台。支持多大模型（智谱/DeepSeek/Gemini）、浏览器扩展一键导入书签与私有化部署。
cporter202 / real-estate-data-apis
A curated directory of real-estate data APIs and web-data workers for listings, valuations, rentals, and market intelligence.
00200200 / maintainer-skills-lab
Curated developer tools, AST analyzers, and automated verification workflows.
nodemaven / google-browser-scraper
Self-hosted Google search scraper for Python. Scrape Google SERP results with a real Chrome browser and your own residential proxy. Self-hosted SERP API alternative with JSON output, an HTTP API and an MCP server for AI agents.
FedeFluork / multistore
A native Android app that aggregates third-party app stores into one catalogue. Search across all of them at once, compare what each publishes for the same app, download and install APKs from the store you pick, and keep what you installed up to date.
sami-mag07 / ultimate-scraper-agent
Research skill and researcher subagent for Claude Code: multi-engine search behind one interface, parallel agent waves, and a verify gate that blocks any citation without a verbatim quote. No personal data; configured via .env.
bunoriapp / bunori
Read, Manage, Download & Export Light Novels, all in one Android app.
cporter202 / google-maps-scraping-apis
A powerhouse collection of Google Maps scraping APIs you can start using immediately to build local lead lists, monitor reviews, and power location intelligence. One of the most valuable Maps data lists on GitHub.
vincenzo-afk / AgentWeb
Free, dependency-light Internet intelligence MVP for grounded research, extraction, citations, and page monitoring.
shanliuling / WxArticleSaver
本地运行的微信公众号文章导出工具，一键保存为 Markdown / HTML / TXT，支持文章内图片与视频下载
mimic-browser / runtime
Mimic: lightweight browser automation without Chromium. JavaScript automation and web scraping with Playwright, Puppeteer and CDP. Source-available public beta; partial compatibility.
kowalski76057 / cf-turnstile-token
Scriptable Cloudflare Turnstile token CLI via the Peak API - sitekey discovery, solve, and token output for CI and automation.
nodemaven / proxy-benchmark
Measurement harness for proxy providers, browser engines and scraping targets. Every claim carries the run it came from.
makralabs / makra
Makra is a memory layer between the web and your AI agents. It serves real-time structured data from the open web at the cost of a vector search.
Encephos / markdown-link-resolver
A zero-dependency Python tool to resolve relative Markdown links and inline images as Base64 strings for RAG and Multimodal LLMs.
vincenzo-afk / Intelis-Agent
A self-running research agent that monitors the web on your schedule, verifies findings with LLM analysis, and delivers intelligence reports by email and in-app.
open-ai-jobs / firecrawl-api-examples
Firecrawl API examples in Python: scrape one URL, map then batch scrape, start a crawl and poll its status.
NopeCHALLC / nopecha-extension
Automated CAPTCHA solver for your browser. Works with Selenium, Puppeteer, Playwright, and more.
maximilianfeix / proxy-scraper
Free HTTP/SOCKS proxies with every check on the record: passed, failed or couldn't run, and when. Hourly list, --pick --verify, --diagnose, rotating proxy, Python API, MCP server.
CircuitSavage / cloudflare-turnstile-reversed
Cloudflare Turnstile challenge internals: the live request flow, the challenge bundle, and a capture toolkit.