πŸ“ˆ GH Trending Explorer 🎲 Surprise me

Search: lakehouse Β· clear

apache / gravitino

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

β–² ~119/7d β˜… 3.3k Java today
apache / doris

Apache Doris is a real-time analytics and hybrid search database for AI agents.

β–² ~61/7d β˜… 16k Java today
lance-format / lance

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

β–² ~44/7d β˜… 7.2k Rust today
StarRocks / starrocks

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

β–² ~19/7d β˜… 12k Java today
parqdb-io / parqdb

Billion-scale embedded vector database built entirely on Parquet and Arrow.

β–² ~16/7d β˜… 109 Python today
delta-io / delta

An open-source storage framework for building Lakehouse architectures with ACID tables accessible from Spark, Flink, Trino, Presto, and Hive.

β–² 15/7d β˜… 9.1k Scala πŸ”₯ today
apache / fluss

Apache Fluss is a streaming storage built for real-time analytics.

β–² ~9/7d β˜… 2.2k Java today
slothflowlabs / duckle

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

β–² ~9/7d β˜… 1.5k Rust 8d ago
databendlabs / databend

Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. β€” rebuilt from scratch. Unified architecture on your S3.

β–² ~7/7d β˜… 9.5k Rust today
lakehq / sail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

β–² ~7/7d β˜… 3.5k Rust today
KratosDataGod / KratosForge

Windows desktop app that runs data jobs on your own machine with DuckDB and Polars, then publishes the results as Delta tables straight to Microsoft Fabric OneLake lakehouses. A run on your PC starts no Fabric job, which cuts Fabric capacity use; OneLake reads and writes still use some.

β–² ~7/7d β˜… 43 Python today
apache / kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

β–² ~5/7d β˜… 2.4k Scala πŸ”₯ 4d ago
apache / incubator-xtable

Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.

β–² ~5/7d β˜… 1.3k Java today
apache / amoro

Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.

β–² ~5/7d β˜… 1.2k Java 2d ago
apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

β–² ~2/7d β˜… 3.4k Java today
lakesoul-io / LakeSoul

LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search β€” powering next-generation BI and AI workloads.

β–² ~2/7d β˜… 3.3k Rust today
ytsaurus / ytsaurus

YTsaurus is a scalable and fault-tolerant open-source big data platform.

β–² ~2/7d β˜… 2.3k C++ today
apache / polaris

Apache Polaris, the interoperable, open source catalog for Apache Iceberg

β–² ~2/7d β˜… 2.1k Java today
lakekeeper / lakekeeper

Apache Iceberg REST Catalog in Rust β€” access control, credential vending and audit for every engine and AI agent. Apache 2.0.

β–² ~2/7d β˜… 1.5k Rust today
prestodb / presto

The official home of the Presto distributed SQL query engine for big data

β–² ~0/7d β˜… 17k Java today
datazip-inc / olake

OLake - Fastest Databases, Kafka & S3 Replication to Apache Iceberg with Table optimization (Called OLake Fusion). ⚑ Efficient, quick and scalable data ingestion for real-time analytics. Supported sources : Postgres, MongoDB, MySQL, Oracle, MSSql, DB2, Kafka, S3.

β–² ~0/7d β˜… 1.6k Go today
Victor-Kipruto-Rop / medallion-lakehouse-platform

A production-grade data engineering platform implementing the Bronze β†’ Silver β†’ Gold medallion architecture for scalable data ingestion, transformation, quality, governance, and analytics.

β–² ~0/7d β˜… 27 Python 2mo ago
openlakestream / ursa

Ursa: a storage engine that implements Lakestream, an open API and specification for stream storage on object storage.