apache / kafka

Distributed event streaming platform for building high-throughput data pipelines and streaming applications.

elastic / elasticsearch

Free and open source distributed RESTful search and analytics engine built on Apache Lucene.

apache / spark

Unified analytics engine for large-scale data processing with APIs in Scala, Java, Python, and R.

kestra-io / kestra

Open-source event-driven orchestration platform for scheduling and running data, AI, and infrastructure workflows defined in YAML.