lexmount / moli

A headless browser runtime in Rust that AI agents use to fetch, extract, search, and automate web pages.

dondai44423 / donsetch

Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.

0xMassi / webclaw

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

fastcrw / crw

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

rust-scraper / scraper

HTML parsing and querying with CSS selectors

monosans / proxy-scraper-checker

Fast proxy scraper and checker written in Rust. Collects HTTP, SOCKS4 and SOCKS5 proxies from any number of sources, verifies each one really works, and writes JSON and plain text with response time, exit IP, ASN and geolocation. Single binary for Windows, Linux, macOS and Android, with an interactive TUI.

austin-weeks / miasma

Trap AI web scrapers in an endless poison pit.

0x676e67 / wreq

An ergonomic, privacy-aware Rust HTTP Client

proofofbots / web-re-toolkit

Headless Akamai & Kasada solver that runs without a browser, and the reversing toolkit it was built with

giancarloerra / Degauss

Official repository for Degauss, the blazing-fast, lightweight frontend for MiSTer FPGA. CRT & HDMI, integrated with the standard MiSTer setup, folders and scripts. Browse games already on your card, scrape artwork and metadata directly on MiSTer, use local artwork databases, customise themes and views, and launch without background processes.