adbar / trafilatura
git clone https://github.com/adbar/trafilatura.git
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
—
stars, 24h
—
stars, 7 days
—
stars, 30 days
7.0k
★ total
461
forks · 92 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguagePython
LicenseApache-2.0
Created2019-04-08 (7y ago)
Last push14d ago
OwnerUser
GitHub topics
article-extractorcorpus-buildercorpus-toolscrawlerhtml-to-markdownhtml2textllmnews-aggregatornews-crawlernlpragreadabilityrss-feedscrapingteitext-cleaningtext-extractiontext-miningtext-preprocessingweb-scraping
Links
- GitHub: github.com/adbar/trafilatura
- Homepage: https://trafilatura.readthedocs.io
- Releases · Issues · Hacker News mentions