data-privacy-stack / presidio
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
data-privacy-stack / presidio
cocoindex-io / cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
open-metadata / OpenMetadata
The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
johnkerl / miller
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
NVIDIA / DALI
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
Th0rgal / open_oura
A Rust toolkit for the Oura Ring (Gen 3/4/5): reverse-engineered BLE protocol, event decoders, and reimplemented data-processing algorithms. Sync, store, and analyze your data locally.
pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
datajuicer / data-juicer
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
unionai-oss / pandera
A light-weight, flexible, and expressive statistical data testing library
ceyyy427 / finathink
Finathink — Financial Research Optimizer for auditable, point-in-time research, mathematical learning, and constrained portfolio analysis.
onceupon / Bash-Oneliner
A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.
OpenDCAI / DataFlow
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
TomWright / dasel
Unified querying, transformation, and modification of JSON, TOML, YAML, XML, INI, HCL, KDL and CSV.
Countly / countly-server
Countly is a privacy-first, AI-powered analytics and engagement platform for understanding and optimizing customer journeys across digital applications, from desktop and mobile to IoT and connected environments.
iflytek / astron-rpa
Agent-ready RPA suite with out-of-the-box automation tools. Built for individuals and enterprises.
sodadata / soda-core
Data Contracts engine for the modern data stack. https://www.soda.io
datacontract / datacontract-cli
Open-source data contract testing for Snowflake, Databricks, BigQuery, Kafka & 15 more. Built on the Open Data Contract Standard (ODCS). MIT.
kanisterio / kanister
An extensible framework for application-level data management on Kubernetes, Kanister is a Cloud Native Computing Foundation sandbox project and was originally created by the Veeam Kasten team.
fivetran / great_expectations
Always know what to expect from your data.
beclab / Olares
Open-Source Personal Cloud OS for Always-On Agents
fluvio-community / fluvio
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
numaproj / numaflow
Kubernetes-native platform to run massively parallel data/streaming jobs
datachain-ai / datachain
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
MarquezProject / marquez
Collect, aggregate, and visualize a data ecosystem's metadata
bytewax / bytewax
Python Stream Processing
NVIDIA-NeMo / Curator
Scalable data pre processing and curation toolkit for LLMs
lotus-data / lotus
Optimized Agentic and LLM Bulk Processing Over Your Data
skrub-data / skrub
Machine learning with dataframes
siddhi-io / siddhi
Stream Processing and Complex Event Processing Engine
quixio / quix-streams
Python Streaming DataFrames for Kafka
EthicalML / awesome-artificial-intelligence-regulation
This repository aims to map the ecosystem of artificial intelligence guidelines, principles, codes of ethics, standards, regulation and beyond.
opendatadiscovery / odd-platform
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
kookxiang / jellyfin-plugin-bangumi
bgm.tv plugin for jellyfin
backube / volsync
Asynchronous data replication for Kubernetes volumes
Sushegaad / Claude-Skills-Governance-Risk-and-Compliance
Claude Skills for Governance, Risk, & Compliance (GRC): Expert-level compliance guidance for ISO 27001, SOC 2, FedRAMP, GDPR, HIPAA, NIST CSF, PCI DSS, EU AI Act, ISO 42001, ISO 27701, DORA, CSRD, India's DPDPA, CMMC 2.0, NIST AI Risk, SWIFT, CCPA/CPRA, and others. Benchmark 89% (with skills) vs 55% (without skills). Updated Monthly.
data-prep-kit / data-prep-kit
Open source project for data preparation for GenAI applications
IBM / differential-privacy-library
Diffprivlib: The IBM Differential Privacy Library
blaylockbk / Herbie
Download numerical weather prediction datasets (HRRR, RAP, GFS, IFS, etc.) from NOMADS, NODD partners (Amazon, Google, Microsoft), ECMWF open data, and the University of Utah Pando Archive System.
google / grain
Library for reading and processing ML training data.
sgasser / pasteguard
AI gets the context. Not your private data. Local-first privacy proxy for browser chat, AI APIs, and coding agents.
aiidateam / aiida-core
The official repository for the AiiDA code
nymtech / nym-vpn-client
Cross-platform open source VPN client built in Rust, with mixnet anonymity and WireGuard speed. Protects metadata, not just IP addresses. Zero-knowledge payments for unlinkable online activities.
TangleML / tangle
Tangle is a web app that allows the users to build and run Machine Learning pipelines without having to set up development environment.
Desbordante / desbordante-core
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
Puchaczov / Musoq
SQL Runtime without any database
bwipp / postscriptbarcode
Barcode Writer in Pure PostScript
halofyai / halofy
Halofy is the open access and governance layer for AI agents across your organization. Identity, policy, provenance, audit, and signed erasure.
shahidazam2020-oss / A-Comparative-Machine-Learning-Framework-for-Heart-Attack-Risk-Prediction-Using-Data-Preprocessing
This project presents a comparative machine learning framework for heart attack risk prediction using Python. It includes data preprocessing, feature engineering, SMOTE for class balancing, cross validation, and performance evaluation of multiple ML models.
sashyo / minidauth
Mini decentralised auth. Gives an existing auth system a key nobody holds, with governance over who can decrypt.
devilgamingopyt44-droid / Arq-Backup-Cloud-Setup-Guide
Arq Backup 2026 Guide: Secure Windows 11 & 10 Cloud Restore Setup
uczltw6 / trace-file-lineage
Find which script, notebook, data, command, or AI agent produced a file — locally, with evidence and honest uncertainty.
kajeesan / Open-Health-Atlas
Explore sleep, training, mood and nutrition together using local records, traceable calculations and optional MCP tools for your preferred AI client.
PerryLink / dsh-data-quality
DeepSeek Harness plugin: deterministic data profiling, cleaning, and verification (dsh-data-quality)
MahdiKordian / DataForge
Automated data preparation for machine learning. Load a dataset, clean, transform, encode, scale and split it, explore it with built-in analysis, and export model-ready data with a full report. Built with Python and Streamlit.
drumandbytes / eraser
Free, open-source data broker removal tool: send GDPR/CCPA opt-out requests to 700+ data brokers automatically. Maintained continuation of digisamroc/eraser.
GetSHIM / shim-cli
Local traffic visibility and privacy controls for coding agents. See what Claude Code, Codex and Copilot send to the model; mask secrets and personal data where the client allows it.
Encephos / markdown-link-resolver
A zero-dependency Python tool to resolve relative Markdown links and inline images as Base64 strings for RAG and Multimodal LLMs.
shellharbor / backfort
Backfort is a secure Linux backup and disaster recovery tool for files and Docker Compose. Create encrypted, compressed, verifiable backups with age, GPG, Minisign, rclone, S3-compatible storage, retention policies, database dumps, atomic publishing, safe restore, watchdog checks, and instant recovery workflows for servers.
rocketride-org / rocketride-server
High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.
cxfksword / jellyfin-plugin-metashark
jellyfin电影元数据插件