apache / spark

Apache Spark - A unified analytics engine for large-scale data processing

apache / datafusion-comet

Apache DataFusion Comet Spark Accelerator

apache / gluten

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

snowplow / snowplow

The leader in Customer Data Infrastructure

apache / carbondata

High performance data store solution

NVIDIA / cudf-spark

NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

spotify / scio

A Scala API for Apache Beam and Google Cloud Dataflow.