pola-rs / polars
Extremely fast Query Engine for DataFrames, written in Rust
pola-rs / polars
lance-format / lance
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
perspective-dev / perspective
A data visualization and analytics component, especially well-suited for large and/or streaming datasets.
apache / datafusion
Apache DataFusion SQL Query Engine
vortex-data / vortex
An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.
apache / auron
Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.
lakehq / sail
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Eventual-Inc / Daft
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
apache / datafusion-ballista
Apache DataFusion Ballista Distributed Query Engine
apache / arrow-rs
Official Rust implementation of Apache Arrow
lakesoul-io / LakeSoul
LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.
nisshi-io / nisshi
Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake
apache / datafusion-iceberg
Apache DataFusion Iceberg Integration
duckdb / duckdb-rs
Ergonomic bindings to duckdb for Rust
kylebarron / parquet-wasm
Rust-based WebAssembly bindings to read and write Apache Parquet data
NOFireAI / ravel
A distributed OpenTelemetry-native columnar datastore whose only backend is object storage.
dataglotai / dataglot
Rust-native federated SQL query engine with governance enforced in the query plan. One PostgreSQL endpoint for all your databases.
ArrowSK / ha-astronomy-observer
A practical night-planning companion for amateur astronomers, with observing windows, forecasts and targets.
underloam / xbbg
Intuitive Data Workflows