DuckDB is a high-performance analytical database system
Apache Kafka - A distributed event streaming platform
SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
ClickHouseยฎ is a real-time analytics database management system
Event Driven Orchestration & Scheduling Platform for Mission Critical Applications
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here ๐๐ผ
Apache Spark - A unified analytics engine for large-scale data processing
Free and Open Source, Distributed, RESTful Search Engine
A self-hosted data logger for your Tesla ๐ [main maintainer=@JakobLichterfeld]
For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.
The financial transactions database designed for mission critical safety and performance.
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
QuestDB is a high performance, open-source, time-series database
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
A pure PHP library for reading and writing spreadsheet files
Apache Flink
HydraDB - fast graph database on object storage
Azure Data SQL Samples - Official Microsoft GitHub Repository containing code samples for SQL Server, Azure SQL, Azure Synapse, and Azure SQL Edge
Apache DataFusion Comet Spark Accelerator
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
dplyr: A grammar of data manipulation
Ultralightweight JSON parser in ANSI C
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.