apache / kafka
Apache Kafka - A distributed event streaming platform
apache / kafka
pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
DataTalksClub / data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
influxdata / telegraf
Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
debezium / debezium
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
redpanda-data / redpanda
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
IBM / sarama
Sarama is a Go library for Apache Kafka.
AutoMQ / automq
Diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
risingwavelabs / risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
redpanda-data / connect
Fancy stream processing made operationally mundane
HariSekhon / DevOps-Bash-tools
1200+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..
Graylog2 / graylog2-server
Free and open log management
dotnetcore / CAP
Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern
flexprice / flexprice
Usage-based pricing and billing for developers 🔓 Cloud or self-hosted ⚙️ No-code UI 💰 Realtime usage metering 🎟 Credits & top-ups 🔑 Control feature access
apache / flink-cdc
Flink CDC is a streaming data integration tool
MaterializeInc / materialize
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
apache / camel
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
obsidiandynamics / kafdrop
Kafka Web UI
strimzi / strimzi-kafka-operator
Apache Kafka® running on Kubernetes
dpkp / kafka-python
Python client for Apache Kafka
ag2ai / faststream
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
asyncapi / spec
The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.
tianshiyeben / wgcloud
Linux运维监控工具，支持系统硬件信息，内存，CPU，温度，磁盘空间及IO，硬盘smart，GPU，防火墙，网络流量速率等监控，服务接口监测，大屏展示，拓扑图，端口监控，进程监控，docker监控，日志监控，文件防篡改，数据库监控，指令批量下发执行，web ssh，Linux面板(探针)，告警，SNMP监测，K8S，Redis，Nginx，Kafka，资产管理，计划任务，密码管理，工作笔记
confluentinc / confluent-kafka-go
Confluent's Apache Kafka Golang client
ArroyoSystems / arroyo
Distributed stream processing engine in Rust
memgraph / memgraph
High-performance open-source in-memory graph database for GraphRAG, AI memory, agentic AI, and real-time graph analytics. Cypher-compatible, built in C++.
redpanda-data / console
Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.
zendesk / maxwell
Maxwell's daemon, a mysql-to-json kafka producer
tchiotludo / akhq
Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...
conduktor / kafka-stack-docker-compose
docker compose files to create a fully working kafka stack
svix / svix-webhooks
The open source and enterprise-ready webhooks service 🦀
PeerDB-io / peerdb
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
twmb / franz-go
franz-go is a feature complete, pure Go library for Kafka from 0.8.0 through 4.4+. Producing, consuming, transacting, administrating, etc.
cruise-control-for-kafka / cruise-control
Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.
liftbridge-io / liftbridge
Kafka-style message streaming in Go. Built on NATS. Single binary, no JVM, no ZooKeeper.
kafbat / kafka-ui
Open-Source Web UI for managing Apache Kafka clusters
lovoo / goka
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
danielqsj / kafka_exporter
Kafka exporter for Prometheus
spring-projects / spring-kafka
Provides Familiar Spring Abstractions for Apache Kafka
BrighterCommand / Brighter
A framework for building messaging apps with .NET and C#.
confluentinc / schema-registry
Confluent Schema Registry for Kafka
phongnguyend / Practical.CleanArchitecture
Full-stack .Net 10 Clean Architecture (Microservices, Modular Monolith, Monolith), Blazor, Angular 22, React 19, Vue 3.5, BFF with YARP, NextJs 16, Domain-Driven Design, CQRS, SOLID, Asp.Net Core Identity Custom Storage, OpenID Connect, EF Core, OpenTelemetry, SignalR, Background Services, Health Checks, Rate Limiting, Clouds (Azure, AWS, GCP), ...
openmeterio / openmeter
Metering and Billing for AI, API and DevOps. Collect and aggregate millions of usage events in real-time and enable usage-based billing.
akvorado / akvorado
Flow collector, enricher and visualizer
syslog-ng / syslog-ng
syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.
rsyslog / rsyslog
High-performance log ingestion and ETL engine
karafka / karafka
Ruby and Rails efficient Kafka processing framework
Blizzard / node-rdkafka
Node.js bindings for librdkafka
php-rdkafka / php-rdkafka
Production-ready, stable Kafka client for PHP
warpstreamlabs / bento
Fancy stream processing made operationally mundane. This repository is a fork of the original project before the license was changed.
Syngnat / GoNavi
High-performance multi-data-source database client — ~30MB, AI & MCP ready, zero Electron bloat. | 高性能多数据源数据库客户端：约 30MB，AI 与 MCP 就绪，告别 Electron 膨胀。
confluentinc / examples
Apache Kafka, Apache Flink and Confluent Platform examples and demos
javahongxi / whatsmars
Java生态研究(Spring Boot + Redis + Dubbo + RocketMQ + Elasticsearch)🔥🔥🔥🔥🔥
nisshi-io / nisshi
Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake
faust-streaming / faust
Python Stream Processing. A Faust fork
robustmq / robustmq
Communication infrastructure for the AI era — one binary, one broker, one storage layer, any protocol
aklivity / zilla
🦎 A lightweight, multi-protocol gateway for event-driven applications and AI agents. Expose and govern Kafka, MQTT, APIs, and MCP through one high-performance engine with shared routing, security, schema, and observability.
quixio / quix-streams
Python Streaming DataFrames for Kafka
confluentinc / demo-scene
Scripts and samples to support Confluent Demos, Talks, and Blogs. Not all of the examples in this repository are kept up to date. For automated tutorials and QA'd code, see https://github.com/confluentinc/tutorials/
datazip-inc / olake
OLake - Fastest Databases, Kafka & S3 Replication to Apache Iceberg with Table optimization (Called OLake Fusion). ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supported sources : Postgres, MongoDB, MySQL, Oracle, MSSql, DB2, Kafka, S3.