rocketride-org / rocketride-server
High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.
docling-project / docling
Get your documents ready for gen AI
Evil0ctal / Douyin_TikTok_Download_API
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
duckdb / duckdb
DuckDB is a high-performance analytical database system
DataTalksClub / data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
semantica-agi / semantica
Graph-Native Infrastructure for Context and Accountable AI Systems
OpenDCAI / DataFlow
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
jxwfdpt42t-ship-it / ReskillSQL
A Text-to-SQL agent that diagnoses failed queries and promotes validated, versioned query-writing skill updates instead of changing model weights.
kestra-io / kestra
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
tursodatabase / turso
A SQL database in Rust: SQLite-compatible, now also speaking Postgres (experimental). The LLVM of databases.
milvus-io / milvus
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
pgvector / pgvector
Open-source vector similarity search for Postgres
opendataloader-project / opendataloader-pdf
PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.
apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
DataWithBaraa / claude-code-data-engineering-skills
A set of 16 Claude Code skills for data engineering tasks like profiling sources, incident investigation, metadata, and code review.
Unstructured-IO / unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
cocoindex-io / cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
OpenTenBase / OpenTenBase
OpenTenBase is an enterprise-level distributed HTAP open source database.
debezium / debezium
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
lionsoul2014 / ip2region
Ip2region is an offline IP-to-Region localization library and IP data management framework with both IPv4 and IPv6 supports, 10-microsecond level query efficiency, xdb search client for many programming languages
StarRocks / starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
questdb / questdb
QuestDB is a high performance, open-source, time-series database
apache / nifi
Apache NiFi
apache / flink
Apache Flink
Cyan4973 / xxHash
Extremely fast non-cryptographic hash algorithm
meta / rocksdb
A library that provides an embeddable, persistent key-value store for fast storage.
argoproj / argo-workflows
Workflow Engine for Kubernetes
apache / beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
apache / cassandra
Open source transactional distributed database. Linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructure without compromising performance.
OpenRefine / OpenRefine
OpenRefine is a free, open source power tool for working with messy data and improving it
fluent / fluent-bit
Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows
apache / kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
gpsaggese / gpsaggese.github.io
Course materials, tutorials, and projects for two University of Maryland graduate machine learning and big data classes.
zio / zio
ZIO — A type-safe, composable library for async and concurrent programming in Scala
apache / arrow-go
Official Go implementation of Apache Arrow
likaela / PMC-Agent-Public
Manufacturing production-planning assistant that answers natural-language queries about BOMs, inventory, and material shortages for PMC planners.
terraform-google-modules / terraform-google-bigquery
Creates opinionated BigQuery datasets and tables
melihbirim / csvql
SQL queries for CSV files. The analytical CSV query engine for AI agents cli: csvql.
zoltanctoth / dbt-student-repo
Starter Repository for the Complete dbt Bootcamp Zero to Hero Course
stackabletech / docker-images
Product images for the Stackable Data Platform
snowplow / snowplow
The leader in Customer Data Infrastructure
Rdatatable / data.table
R's data.table package extends data.frame:
antflydb / antfly
Open-source search-and-inference database in Zig combining full-text, dense and sparse vector, and graph indexes with in-process ML models.
tidyverse / dplyr
dplyr: A grammar of data manipulation