All repos — GH Trending Explorer

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

D4Vinci / Scrapling

🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

ScrapeGraphAI / Scrapegraph-ai

Python scraper based on AI

lexmount / moli

Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust

getmaxun / maxun

Turn any website into a structured API. Extract, automate, search and monitor the web.

gosom / google-maps-scraper

scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

php-curl-class / php-curl-class

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

itsOwen / CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

lncrawl / lightnovel-crawler

Generate and download e-books from online sources.

anaskhan96 / soup

Web Scraper in Go, similar to BeautifulSoup

gildas-lormeau / single-file-cli

CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)

fastcrw / crw

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.