NVIDIA-NeMo / Curator

Scalable data pre processing and curation toolkit for LLMs

data-prep-kit / data-prep-kit

Open source project for data preparation for GenAI applications