lexmount / moli
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
lexmount / moli
rust-scraper / scraper
HTML parsing and querying with CSS selectors
0xMassi / webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
monosans / proxy-scraper-checker
Fast proxy scraper and checker written in Rust. Collects HTTP, SOCKS4 and SOCKS5 proxies from any number of sources, verifies each one really works, and writes JSON and plain text with response time, exit IP, ASN and geolocation. Single binary for Windows, Linux, macOS and Android, with an interactive TUI.
austin-weeks / miasma
Trap AI web scrapers in an endless poison pit.
fastcrw / crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
0x676e67 / wreq
An ergonomic, privacy-aware Rust HTTP Client
dondai44423 / donsetch
Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.
proofofbots / web-re-toolkit
Headless Akamai & Kasada solver that runs without a browser, and the reversing toolkit it was built with