Unstructured-IO / unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
adbar / trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
shahidazam2020-oss / A-Comparative-Machine-Learning-Framework-for-Heart-Attack-Risk-Prediction-Using-Data-Preprocessing
This project presents a comparative machine learning framework for heart attack risk prediction using Python. It includes data preprocessing, feature engineering, SMOTE for class balancing, cross validation, and performance evaluation of multiple ML models.
crosire / reshade
A generic post-processing injector for games and video software.
skrub-data / skrub
Machine learning with dataframes
sccn / eeglab
EEGLAB is an open source signal processing environment for electrophysiological signals running on Matlab and developed at the SCCN/UCSD
pngwn / MDsveX
A markdown preprocessor for Svelte.
winedarksea / AutoTS
Automated Time Series Forecasting
dongrixinyu / JioNLP
中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com
OpenGene / fastp
An ultra-fast all-in-one FASTQ preprocessor (QC/adapters/trimming/filtering/splitting/merging...)
sunlabuiuc / PyHealth
A Deep Learning Python Toolkit for Healthcare Applications.
speced / bikeshed
:bike: A preprocessor for anyone writing specifications that converts source files into actual specs.
MinishLab / semhash
Fast Multimodal Semantic Deduplication & Filtering
data-prep-kit / data-prep-kit
Open source project for data preparation for GenAI applications
nipreps / fmriprep
fMRIPrep is a robust and easy-to-use pipeline for preprocessing of diverse fMRI data. The transparent workflow dispenses of manual intervention, thereby ensuring the reproducibility of the results.
Zesuy / Plugin-Deepseek-Vision
CLIProxyAPI v7 plugin for DeepSeek Responses vision preprocessing
aquacropos / geoaquacrop
Run AquaCrop-OSPy over large regions in gridded format — preprocessing, simulation and visualisation behind one import.
Encephos / markdown-link-resolver
A zero-dependency Python tool to resolve relative Markdown links and inline images as Base64 strings for RAG and Multimodal LLMs.
Fannovel16 / comfyui_controlnet_aux
ComfyUI's ControlNet Auxiliary Preprocessors
sass / dart-sass
The reference implementation of Sass, written in Dart.
manifold-systems / manifold
Manifold is a Java compiler plugin, its features include Metaprogramming, Properties, Extension Methods, Operator Overloading, Templates, a Preprocessor, and more.
The-Japan-DataScientist-Society / 100knocks-preprocess
データサイエンス100本ノック（構造化データ加工編）
vnphanquang / svelte-put
Useful svelte stuff to put in your projects
google / seqio
Task-based datasets, preprocessing, and evaluation for sequence models.
tyfkda / xcc
Standalone C compiler/assembler/linker/libc for x86-64/aarch64/riscv64/wasm
Desbordante / desbordante-core
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
martinguirado95-ux / untangling-ml-complexity
Clean ML Framework 2026: Simplify Machine Learning Code Structure and Hyperparameters
MahdiKordian / DataForge
Automated data preparation for machine learning. Load a dataset, clean, transform, encode, scale and split it, explore it with built-in analysis, and export model-ready data with a full report. Built with Python and Streamlit.
nickhuang1121 / lollipop-css
🍭 A tiny CSS preprocessor for lazy developers. Define your own shortcuts, write less CSS, and save more time for McFlurries.