An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
Apache Flink
The Open Control Plane for Real-Time Data
The Fastest Unified Streaming SQL Engine in a Single C++ Binary. β‘ Millisecond latency. 100+ GB/s throughput. Continuously compute real-time context from streams, logs, metrics, events, and CDC.
Support agile Ontology DataOps Based on Flink, DataX and Flink-CDC with Web-UI
Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
Flink CDC is a streaming data integration tool
Upserts, Deletes And Incremental Processing on Big Data.
A data integration framework
Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search β powering next-generation BI and AI workloads.
Apache Kafka, Apache Flink and Confluent Platform examples and demos
Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.
Apache Flink Kubernetes Operator
Yet Another UserAgent Analyzer
Low-code tool for automating actions on real time data | Stream processing for the users.
Apache Flink Playgrounds