D4Vinci / Scrapling
git clone https://github.com/D4Vinci/Scrapling.git
v0.5 · 8d ago
Python web scraping framework combining HTTP fetching, stealth browsers, parsing, and concurrent spider crawling in one library.
Why you might care
Covers the full scraping workflow from a single page to a whole-site crawl, with CSS/XPath selectors, adaptive element tracking, proxy rotation, retries, pause/resume, and JSON/CSV exports. Includes an MCP server and CLI so AI agents or terminal users can scrape without writing Python.
+200
stars, 24h · #207
+~1.0k
stars, 7 days · #244
+~4.4k
stars, 30 days · #214
90k
★ total · +1% this week
9.3k
forks · 20 open issues
Star history (as recorded here)
LanguagePython
LicenseBSD-3-Clause
Created2024-10-13 (2y ago)
Last push3d ago
Watchers324
OwnerUser
GitHub topics
aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
Links
- GitHub: github.com/D4Vinci/Scrapling
- Homepage: https://scrapling.readthedocs.io/en/latest/
- Releases · Issues · Hacker News mentions
README
Loading README…
Blurb generated by claude-haiku-5-5 today. Star deltas marked ~ are extrapolated from partial history.