context-dot-dev / rusteerio

Cheerio-compatible HTML/XML processing powered by Rust, with configurable parallel extraction. Built by context.dev.

firecrawl / firecrawl

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

JCodesMore / ai-website-cloner-template

Clone any website with one command using AI coding agents

apify / crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

browserbase / stagehand

The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.

getmaxun / maxun

Turn any website into a structured API. Extract, automate, search and monitor the web.

nanobrowser / nanobrowser

Open-source AI agent for web automation. Use your real, logged-in browser to automate daily tasks.

mobile-next / mobile-mcp

Model Context Protocol Server for Mobile Automation and Scraping (iOS, Android, Emulators, Simulators and Real Devices)

KnockOutEZ / wigolo

The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.

Kaliiiiiiiiii-Vinyzu / patchright

Undetected version of the Playwright testing and automation library.

any4ai / AnyCrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

botswin / BotBrowser

Advanced Privacy Browser Core with Unified Fingerprint Defense: Cloudflare, Akamai, Kasada, Shape, DataDome, PerimeterX, hCaptcha, FunCaptcha, Imperva, reCAPTCHA, ThreatMetrix, Adscore

apify / fingerprint-suite

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

saifyxpro / HeadlessX

The undetected self-hosted browser automation platform. Powered by Camoufox (Firefox) for 0% detection rates. Built for speed, privacy, and scalability.

intoli / user-agents

A JavaScript library for generating random user agents with data that's updated daily.

germondai / trawl

Self-hosted scraping engine — bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr alternative and drop-in replacement for your *arr stack.

Kaliiiiiiiiii-Vinyzu / patchright-nodejs

Undetected NodeJS version of the Playwright testing and automation library.

apify / got-scraping

HTTP client made for scraping based on got.

figranium / figranium

Stack blocks visually to build complex browser workflows and execute them via API

firecrawl / cli

Firecrawl CLI and agent skills: search, scrape, and interact with the web from your terminal or any coding agent, plus parse, crawl, map, Agent and Monitor. Firecrawl is the context API for AI agents.

vakra-dev / reader

Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.

ryanlaiyanip-ctrl / chatmany

Self-hosted Instagram comment-to-DM automation on the official Meta API. Deploy your own on Cloudflare's free tier — no scraping, no subscription, no App Review.

divinelabio / Aegis

Next-Gen Selfhosted Web Application Firewall (WAF) & Edge Reverse Proxy built in Go. Real-time threat defense, L7 traffic control, and unified admin console.

alijancb / subio-mcp

MCP server that scrapes public posts from X, LinkedIn and Hacker News in a local browser that is never signed in

vincenzo-afk / Intelis-Agent

A self-running research agent that monitors the web on your schedule, verifies findings with LLM analysis, and delivers intelligence reports by email and in-app.