JCodesMore / ai-website-cloner-template

Clone any website with one command using AI coding agents

getmaxun / maxun

Turn any website into a structured API. Extract, automate, search and monitor the web.

browserbase / stagehand

The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.

Kaliiiiiiiiii-Vinyzu / patchright

Undetected version of the Playwright testing and automation library.

nanobrowser / nanobrowser

Open-source AI agent for web automation. Use your real, logged-in browser to automate daily tasks.

apify / crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

context-dot-dev / rusteerio

Cheerio-compatible HTML/XML processing powered by Rust, with configurable parallel extraction. Built by context.dev.

KnockOutEZ / wigolo

The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.

germondai / trawl

Self-hosted scraping engine — bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr alternative and drop-in replacement for your *arr stack.

Kaliiiiiiiiii-Vinyzu / patchright-nodejs

Undetected NodeJS version of the Playwright testing and automation library.

figranium / figranium

Stack blocks visually to build complex browser workflows and execute them via API

firecrawl / cli

Firecrawl CLI and agent skills: search, scrape, and interact with the web from your terminal or any coding agent, plus parse, crawl, map, Agent and Monitor. Firecrawl is the context API for AI agents.

vakra-dev / reader

Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.

saifyxpro / HeadlessX

The undetected self-hosted browser automation platform. Powered by Camoufox (Firefox) for 0% detection rates. Built for speed, privacy, and scalability.

intoli / user-agents

A JavaScript library for generating random user agents with data that's updated daily.

any4ai / AnyCrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

botswin / BotBrowser

Advanced Privacy Browser Core with Unified Fingerprint Defense: Cloudflare, Akamai, Kasada, Shape, DataDome, PerimeterX, hCaptcha, FunCaptcha, Imperva, reCAPTCHA, ThreatMetrix, Adscore

apify / fingerprint-suite

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

ryanlaiyanip-ctrl / chatmany

Self-hosted Instagram comment-to-DM automation on the official Meta API. Deploy your own on Cloudflare's free tier — no scraping, no subscription, no App Review.

alijancb / subio-mcp

MCP server that scrapes public posts from X, LinkedIn and Hacker News in a local browser that is never signed in

vincenzo-afk / Intelis-Agent

A self-running research agent that monitors the web on your schedule, verifies findings with LLM analysis, and delivers intelligence reports by email and in-app.

apify / got-scraping

HTTP client made for scraping based on got.

divinelabio / Aegis

Next-Gen Selfhosted Web Application Firewall (WAF) & Edge Reverse Proxy built in Go. Real-time threat defense, L7 traffic control, and unified admin console.

ProxyShard / ShardBrowser

Free, open-source anti-detect browser launcher for web scraping and multi-accounting. By the ProxyShard team. Engine-level fingerprint spoofing in Chromium 156 (WebGL / WebGPU / Client Hints / fonts / TLS), 220+ device profiles bundled, stable QUIC + WebRTC over SOCKS5.