📈 GH Trending Explorer 🎲 Surprise me

← all repos

firecrawl / firecrawl

git clone https://github.com/firecrawl/firecrawl.git v2.11.0 · 4mo ago 🔥 on GitHub Trending today

Hosted and open-source API that searches the web and converts pages, documents, and sites into LLM-ready markdown or structured JSON.

Why you might care

Aimed at AI agents and apps that need clean web data without running their own scraping infrastructure; it handles JS-heavy pages, proxies, and rate limits. Covers search, scrape, crawl, map, batch scrape, parsing of PDFs and DOCX, and change monitoring, with an MCP client option. Note the license is AGPL-3.0, which matters for embedding it in closed-source products.

Categories

Alternatives

Crawl4AIScrapyApifyJina ReaderBrowserless
+396
stars, 24h · #72
+~2.2k
stars, 7 days · #88
+~9.6k
stars, 30 days · #74
194k
★ total · +1% this week
10k
forks · 652 open issues

Star history (as recorded here)

2026-10-20 · 193,438 ★ 2026-10-23 · 194,401 ★
LanguageTypeScript
LicenseAGPL-3.0
Created2024-04-15 (2y ago)
Last pushtoday
Watchers494
OwnerOrganization

Seen on GitHub Trending

  • 2026-10-23 — #10 daily in typescript · +424 ★

GitHub topics

Links

README excerpt
---
# **🔥 Firecrawl**
**The API to search, scrape, and interact with the web at scale. Firecrawl is the context API for AI agents. 🔥** Open source and available as a hosted service.
_Pst. Hey, you, join our stargazers :)_
---
## Why Firecrawl?
- **Industry-leading reliability**: Covers 96% of the web, including JS-heavy pages — no proxy headaches, just clean data (see benchmarks)
- **Blazingly fast**: P95 latency of 3.4s across millions of pages, built for real-time agents and dynamic apps
- **LLM-ready output**: Clean markdown, structured JSON, screenshots, and more — spend fewer tokens, build better AI apps
- **We handle the hard stuff**: Rotating proxies, orchestration, rate limits, JS-blocked content, and more — zero configuration
- **Agent ready**: Connect Firecrawl to any AI agent or MCP client with a single command
- **Document parsing**: Turn PDFs, DOCX, and other documents into clean Markdown or structured JSON
- **Actions**: Click, scroll, write, wait, and press before extracting content
- **Open source**: Developed transparently and collaboratively — join our community
---
## Feature Overview
**Core Endpoints**
| Feature | Description |
|---------|-------------|
| **Search** | Search the web and get full page content from results |
| **Scrape** | Convert any URL to markdown, HTML, screenshots, or structured JSON |
| **Interact** | Scrape a page, then interact with it using AI prompts or code |
**More**
| Feature | Description |
|---------|-------------|
| **Parse** | Turn PDFs, DOCX, and other documents into clean Markdown or structured JSON |
| **Agent** | Automated data gathering, just describe what you need |
| **Crawl** | Scrape all URLs of a website with a single request |
| **Map** | Discover all URLs on a website instantly |
| **Batch Scrape** | Scrape thousands of URLs asynchronously |
| **Monitor** | Get notified when content on a website changes |
---
## Quick Start
Sign up at firecrawl.dev to get your API key. Try the playground to test it out.
### Search
Search the web and get full content from results.
 [code] 
 Node.js / cURL / CLI 
**Node.js**
 [code] 
**cURL**
 [code] 
**CLI**
 [code] 
Output:
 [code] 
### Scrape
Get LLM-ready context from any website — markdown, JSON, screenshots, and more.
 [code] 
 Node.js / cURL / CLI 
**Node.js**
 [code] 
**cURL**
 [code] 
**CLI**
 [code] 
Output:
 [code] 
### Interact
Scrape a page, then interact with it using AI prompts or code.
 [code] 
 Node.js / cURL / CLI 
**Node.js**
 [code] 
**cURL**
 [code] 
**CLI**
 [code] 
Output:
 [code] 
---
## Power Your Agent
Connect Firecrawl to any AI agent or MCP client in minutes.
### Skill
Give your agent easy access to real-time web data with one command.
 [code] 
Restart your agent after installing. Works with Claude Code, Antigravity, OpenCode, and more.
### MCP
Connect any MCP-compatible client to the web in seconds.
 [code] 
### Agent Onboarding
Are you an AI agent? Fetch this skill to sign up your user, get an API key, and start building w

Blurb generated by claude-haiku-5-5 today. Star deltas marked ~ are extrapolated from partial history.