pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
pathwaycom / pathway
google-ai-edge / mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
vectordotdev / vector
A high-performance observability data pipeline.
questdb / questdb
QuestDB is a high performance, open-source, time-series database
redpanda-data / redpanda
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
risingwavelabs / risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
redpanda-data / connect
Fancy stream processing made operationally mundane
fluent / fluent-bit
Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows
hazelcast / hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
MaterializeInc / materialize
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
apache / hudi
Upserts, Deletes And Incremental Processing on Big Data.
online-ml / river
🌊 Online machine learning in Python
ag2ai / faststream
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
fluvio-community / fluvio
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
ArroyoSystems / arroyo
Distributed stream processing engine in Rust
PeerDB-io / peerdb
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
manuzhang / awesome-streaming
a curated list of awesome streaming frameworks, applications, etc
numaproj / numaflow
Kubernetes-native platform to run massively parallel data/streaming jobs
timeplus-io / proton
The Fastest Unified Streaming SQL Engine in a Single C++ Binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute real-time context from streams, logs, metrics, events, and CDC.
bytewax / bytewax
Python Stream Processing
nerevu / riko
A Python stream processing engine modeled after Yahoo! Pipes
siddhi-io / siddhi
Stream Processing and Complex Event Processing Engine
quixio / quix-streams
Python Streaming DataFrames for Kafka
rxRust / rxRust
Zero-cost & Type-safe Reactive Extensions for Rust. Supports both high-performance single-threaded (Local) and thread-safe (Shared) contexts. WASM & Tokio ready.
spring-cloud / spring-cloud-stream
Framework for building Event-Driven Microservices
gazette / core
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
gearpump / gearpump
Lightweight real-time big data streaming engine over Apache Pekko
apache / streampipes
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.
TouK / nussknacker
Low-code tool for automating actions on real time data | Stream processing for the users.
scalecube / scalecube-services
Microservices library - scalecube-services is a high throughput, low latency reactive microservices library built to scale. It features: API-Gateways, service-discovery, service-load-balancing, the architecture supports plug-and-play service communication modules and features. built to provide performance and low-latency real-time stream-processing
dpnkrpl / radio-active
Play any radios around the globe right from the terminal :zap:
p2panda / p2panda
All the things a panda needs
microsoft / psi
Platform for Situated Intelligence
vinamega / ZenWeaver
ZenWeaver enables real-time, distributed audio processing via stream-processing architecture, auto-scaling, and a robust engine within a scalable platform.