firecrawl / firecrawl

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

cheeriojs / cheerio

The fast, flexible, and elegant library for parsing and manipulating HTML and XML.

apify / crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

getmaxun / maxun

Turn any website into a structured API. Extract, automate, search and monitor the web.

apify / apify-mcp-server

The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.

brightdata / cli

Official Bright Data CLI - scrape, search, and extract structured web data directly from your terminal.

Mathieu2301 / TradingView-API

📈 Get real-time stocks from TradingView

any4ai / AnyCrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

apify / fingerprint-suite

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

zerodytrash / TikTok-Live-Connector

TikTok LIVE API for Node.js: An unofficial library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.

yjl9903 / AnimeGarden

動漫花園 镜像站 | 动画 BT 资源聚合站 | 动画 BT 资源开放接口

eshaham / israeli-bank-scrapers

Provide scrapers for all major Israeli banks and credit card companies

germondai / trawl

Self-hosted scraping engine — bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr alternative and drop-in replacement for your *arr stack.

maoserr / epublifier

Converts some webnovels to epub format

growthenginenowoslawski / coldoutboundskills

Open-source Claude Code skills for cold email and outbound sales. Grade campaigns, export Prospeo searches, scrape Google Maps — all from Claude Code.

firecrawl / cli

Firecrawl CLI and agent skills: search, scrape, and interact with the web from your terminal or any coding agent, plus parse, crawl, map, Agent and Monitor. Firecrawl is the context API for AI agents.

ayush-that / codejeet

🍿 15K+ Company-wise LeetCode Interview Questions and System Design. Filter by company, topic, and difficulty.

vakra-dev / reader

Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.

Vaquill-AI / open-india-law

Open, structured Indian primary law: 32.5M judgment chunks from the Supreme Court and all 25 High Courts, 1.1M legislation provisions, and the scrapers that build it. CC BY 4.0.

erikfiala / google-maps-scraper

Self-hosted Google Maps multi-category scraper with configurable fields and website, email, and phone enrichment.

alijancb / subio-mcp

MCP server that scrapes public posts from X, LinkedIn and Hacker News in a local browser that is never signed in