datajuicer / data-juicer

git clone https://github.com/datajuicer/data-juicer.git

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

—

stars, 24h

—

stars, 7 days

—

stars, 30 days

7.2k

★ total

436

forks · 65 open issues

Star history starts 2026-10-20; the chart appears after the second daily snapshot.

LanguagePython

LicenseApache-2.0

Created2023-08-01 (3y ago)

Last pushtoday

OwnerOrganization

GitHub topics

data data-analysis data-pipeline data-processing data-science data-visualization foundation-models instruction-tuning large-language-models llm llms multi-modal pre-training synthetic-data

Links

GitHub: github.com/datajuicer/data-juicer
Homepage: https://datajuicer.github.io/data-juicer/
Releases · Issues · Hacker News mentions