firecrawl / firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. π₯
firecrawl / firecrawl
apify / apify-mcp-server
The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.
apify / crawlee
CrawleeβA web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
getmaxun / maxun
Turn any website into a structured API. Extract, automate, search and monitor the web.
Mathieu2301 / TradingView-API
π Get real-time stocks from TradingView
cheeriojs / cheerio
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
zerodytrash / TikTok-Live-Connector
TikTok LIVE API for Node.js: An unofficial library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.
eshaham / israeli-bank-scrapers
Provide scrapers for all major Israeli banks and credit card companies
vakra-dev / reader
Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.
any4ai / AnyCrawl
AnyCrawl π: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
apify / fingerprint-suite
Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.
yjl9903 / AnimeGarden
εζΌ«θ±ε ιεη« | ε¨η» BT θ΅ζΊθεη« | ε¨η» BT θ΅ζΊεΌζΎζ₯ε£
germondai / trawl
Self-hosted scraping engine β bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr alternative and drop-in replacement for your *arr stack.
maoserr / epublifier
Converts some webnovels to epub format
ayush-that / codejeet
πΏ 15K+ Company-wise LeetCode Interview Questions and System Design. Filter by company, topic, and difficulty.
Vaquill-AI / open-india-law
Open, structured Indian primary law: 32.5M judgment chunks from the Supreme Court and all 25 High Courts, 1.1M legislation provisions, and the scrapers that build it. CC BY 4.0.
erikfiala / google-maps-scraper
Self-hosted Google Maps multi-category scraper with configurable fields and website, email, and phone enrichment.