johnkerl / miller

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

kafbat / kafka-ui

Open-Source Web UI for managing Apache Kafka clusters

redpanda-data / connect

Fancy stream processing made operationally mundane

MaterializeInc / materialize

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

online-ml / river

🌊 Online machine learning in Python

readysettech / readyset

Readyset is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the results of cached select statements and incrementally updates these results over time as the underlying data changes.

fluvio-community / fluvio

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

piskvorky / smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

bytewax / bytewax

Python Stream Processing

siddhi-io / siddhi

Stream Processing and Complex Event Processing Engine

quixio / quix-streams

Python Streaming DataFrames for Kafka

python-streamz / streamz

Real-time stream processing for python

joshday / OnlineStats.jl

⚡ Single-pass algorithms for statistics

guillermo-navas-palencia / optbinning

Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.

Sinotrade / Shioaji

Shioaji all new cross platform api for trading ( 跨平台證券交易API )