firecrawl / firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
firecrawl / firecrawl
D4Vinci / Scrapling
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
unclecode / crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
ScrapeGraphAI / Scrapegraph-ai
Python scraper based on AI
browserbase / stagehand
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
getmaxun / maxun
Turn any website into a structured API. Extract, automate, search and monitor the web.
xberg-io / xberg
Polyglot document intelligence with a Rust core: extract text, metadata, images, tables, and structured data from 106 formats across 140 file extensions, plus code intelligence for 371 languages. Fifteen bindings, with CLI, REST API, and MCP server.
MontFerret / ferret
Declarative data automation language and Go runtime for structured extraction workflows.
brightdata / brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
saifyxpro / HeadlessX
The undetected self-hosted browser automation platform. Powered by Camoufox (Firefox) for 0% detection rates. Built for speed, privacy, and scalability.
hhursev / recipe-scrapers
Python package for scraping recipes data
shcherbak-ai / contextgem
Extract structured data and insights from documents using LLMs and decision models
schemacrawler / SchemaCrawler
Free database schema discovery and comprehension tool
JonathanLink / PDFLayoutTextStripper
Converts a pdf file into a text file while keeping the layout of the original pdf. Useful to extract the content from a table in a pdf file for instance. This is a subclass of PDFTextStripper class (from the Apache PDFBox library).
thinh-vu / vnstock
A beginner-friendly yet powerful Python toolkit for financial analysis and automation — built to make modern investing accessible to everyone
sybil-solutions / ai-data-extraction
extract all your personal data history from cursor, codex, claude-code, windsurf, and trae
fastcrw / crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
soxoj / socid-extractor
⛏️ The extraction engine behind Maigret: turn any profile URL into a structured OSINT record across 150+ sites
yfedoseev / pdf_oxide
The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.
polyrabbit / hacker-news-digest
:newspaper: Let LLM Summarize Hacker News for You
mrshu / github-statuses
The "Missing GitHub Status Page" -- a Flat Data attempt at historically documenting GitHub statuses
vakra-dev / reader
Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.
photostructure / exiftool-vendored.js
Fast, cross-platform Node.js access to ExifTool
jatechan / ai-data-extractor
Free open-source extractor for AI coding assistant chat histories. Supports Claude Code, Cursor, Windsurf, Aider, Cline/Roo Code and more
cporter202 / coreclaw-api-directory
An unofficial, categorized directory of 118 CoreClaw Worker APIs for web scraping, automation, lead generation, e-commerce, social data, and more.
deckflow / deckprobe
ffprobe for documents — probe PDF, Microsoft Office, and Apple iWork files without opening them. Rust CLI + browser WASM SDK returning structured JSON with confidence, evidence, and measured I/O cost.
tomnio / rubric
Schema-first structured extraction from LLMs — validated JSON from one call or a 150-page document.
cporter202 / google-maps-scraping-apis
A powerhouse collection of Google Maps scraping APIs you can start using immediately to build local lead lists, monitor reviews, and power location intelligence. One of the most valuable Maps data lists on GitHub.
vincenzo-afk / AgentWeb
Free, dependency-light Internet intelligence MVP for grounded research, extraction, citations, and page monitoring.
2captcha / 2captcha-mcp
2Captcha MCP server for AI agents with web search, web scraping, browser automation, captcha solving, and scalable web data collection.
wongedyan / ckelepel-threads
Pure standalone, zero-browser Meta Threads intelligence engine & CLI. Cloud API & SaaS at https://skelepel.id