Unstructured-IO / unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
adbar / trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
dongrixinyu / JioNLP
ไธญๆ NLP ้ขๅค็ใ่งฃๆๅทฅๅ ทๅ ๏ผๅ็กฎใ้ซๆใๆ็จ A Chinese NLP Preprocessing & Parsing Package www.jionlp.com
OpenGene / fastp
An ultra-fast all-in-one FASTQ preprocessor (QC/adapters/trimming/filtering/splitting/merging...)
sunlabuiuc / PyHealth
A Deep Learning Python Toolkit for Healthcare Applications.
skrub-data / skrub
Machine learning with dataframes
winedarksea / AutoTS
Automated Time Series Forecasting
MinishLab / semhash
Fast Multimodal Semantic Deduplication & Filtering
data-prep-kit / data-prep-kit
Open source project for data preparation for GenAI applications
sccn / eeglab
EEGLAB is an open source signal processing environment for electrophysiological signals running on Matlab and developed at the SCCN/UCSD
nipreps / fmriprep
fMRIPrep is a robust and easy-to-use pipeline for preprocessing of diverse fMRI data. The transparent workflow dispenses of manual intervention, thereby ensuring the reproducibility of the results.
google / seqio
Task-based datasets, preprocessing, and evaluation for sequence models.
Desbordante / desbordante-core
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
shahidazam2020-oss / A-Comparative-Machine-Learning-Framework-for-Heart-Attack-Risk-Prediction-Using-Data-Preprocessing
This project presents a comparative machine learning framework for heart attack risk prediction using Python. It includes data preprocessing, feature engineering, SMOTE for class balancing, cross validation, and performance evaluation of multiple ML models.
Zesuy / Plugin-Deepseek-Vision
CLIProxyAPI v7 plugin for DeepSeek Responses vision preprocessing
martinguirado95-ux / untangling-ml-complexity
Clean ML Framework 2026: Simplify Machine Learning Code Structure and Hyperparameters
MahdiKordian / DataForge
Automated data preparation for machine learning. Load a dataset, clean, transform, encode, scale and split it, explore it with built-in analysis, and export model-ready data with a full report. Built with Python and Streamlit.
aquacropos / geoaquacrop
Run AquaCrop-OSPy over large regions in gridded format โ preprocessing, simulation and visualisation behind one import.
Encephos / markdown-link-resolver
A zero-dependency Python tool to resolve relative Markdown links and inline images as Base64 strings for RAG and Multimodal LLMs.