ModernRelay / omnigraph

Object-storage native graph database with git-style branching, a typed ontology, and hybrid graph, vector, and full-text retrieval over Lance files.

VectifyAI / PageIndex

Python library and SDK that builds a hierarchical tree index of documents so an LLM can reason through it for retrieval, without vector databases or chunking.

duckdb / duckdb

Embedded analytical SQL database engine that runs in-process, with clients for Python, R, Java, Rust, Go, and Wasm.

apache / kafka

Distributed event streaming platform for building high-throughput data pipelines and streaming applications.

seaweedfs / seaweedfs

Distributed file and object storage system that serves S3, POSIX file system, and Iceberg/Lance table access from one Go binary.

ClickHouse / ClickHouse

Column-oriented database management system for generating analytical data reports in real time.

kestra-io / kestra

Open-source event-driven orchestration platform for scheduling and running data, AI, and infrastructure workflows defined in YAML.

DataTalksClub / data-engineering-zoomcamp

A free 9-week course teaching data engineering by building an end-to-end data pipeline using tools like Docker, Terraform, Kafka, Spark, and dbt.

apache / spark

Unified analytics engine for large-scale data processing with APIs in Scala, Java, Python, and R.

elastic / elasticsearch

Free and open source distributed RESTful search and analytics engine built on Apache Lucene.

teslamate-org / teslamate

Self-hosted logger that records Tesla vehicle data into Postgres, with Grafana dashboards and MQTT publishing.

redis / redis

In-memory data structure store used as a cache, database, message broker, and vector/document query engine.

tigerbeetle / tigerbeetle

A distributed database for financial transactions, built around debit/credit primitives with a consensus-replicated storage engine.

trinodb / trino

Distributed SQL query engine for big data analytics across many data sources, formerly known as PrestoSQL.

questdb / questdb

Open-source, low-latency time-series database with SQL, streaming ingestion, and tiered storage using native columns and Apache Parquet.

delta-io / delta

An open-source storage framework for building Lakehouse architectures with ACID tables accessible from Spark, Flink, Trino, Presto, and Hive.

PHPOffice / PhpSpreadsheet

A pure PHP library for reading and writing spreadsheet files such as Excel, LibreOffice Calc, and ODS formats.

apache / flink

Open source framework for stateful stream and batch data processing, with Java, Scala, Python, and SQL APIs.

hydra-db / hydradb

Distributed graph database in Rust that stores its data durably on S3-compatible object storage and serves OpenCypher over Bolt and HTTP.

microsoft / sql-server-samples

Official Microsoft collection of code samples and sample databases for SQL Server, Azure SQL Database, Azure Synapse, and Azure SQL Edge.

apache / datafusion-comet

Apache DataFusion Comet is a plugin that accelerates Apache Spark queries by running operators and expressions natively on Arrow columnar data.

apache / gluten

Middleware plugin that offloads Spark SQL physical plan execution to native engines like Velox and ClickHouse.

tidyverse / dplyr

R package providing a consistent set of verbs for filtering, selecting, mutating, summarising, and arranging data frames.

DaveGamble / cJSON

Ultralightweight JSON parser and printer written in ANSI C, distributed as a single source file and header.

deepseek-ai / 3FS

A distributed file system from DeepSeek that uses SSDs and RDMA networks to serve storage for AI training and inference workloads.