pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
pathwaycom / pathway
dpkp / kafka-python
Python client for Apache Kafka
ag2ai / faststream
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
faust-streaming / faust
Python Stream Processing. A Faust fork
quixio / quix-streams
Python Streaming DataFrames for Kafka
aio-libs / aiokafka
asyncio client for kafka
sauljabin / kaskade
kaskade is a text user interface for kafka, which allows you to interact and consume topics from your terminal in style!
Aiven-Open / karapace
Karapace - Your Apache Kafka® essentials in one tool
confluentinc / confluent-kafka-python
Confluent's Kafka Python Client
schumannx / full-stack-data-engineering
End-to-end streaming data platform on AWS: Kafka → Iceberg lake → Kimball model → Athena, orchestrated with Airflow 3. Terraform, Glue PySpark, dbt.
Jiarui-0410 / real-time-recommendation-analytics
End-to-end retail analytics and recommendation platform using PySpark, Kafka, PostgreSQL, Power BI, PyTorch Two-Tower, Qdrant, FastAPI, Docker and Azure.
kkjiangk / agent-py
Personal AIOps engineering project with durable workflows, scoped hybrid retrieval, reliable event delivery, and verified API/browser contracts.
beianchuqing111 / drone-fire-platform
面向无人机机场的实时视频 AI 火情检测服务：Kafka 任务调度 → 直播流多模型检测 → 地理定位 → 向量去重 → MQTT 报警
seed-forge / harness-ai-kit
Package manager for AI agent assets — 42 skills, 5 CLIs, 1 plugin. Skills for AI/LLM agent engineering, eval-driven dev, spec-driven dev, database (MySQL/PG/Redis/Kafka/Mongo/Oracle/NL2SQL), K8s/Docker diagnostics, infra ops (Dify/Nexus/Harbor/SonarQube) & docs/patent. Runtimes: Codex, Claude Code, Cursor, Kiro, DSH.
Unknown-333 / awesome-data-engineering-skills
36 data-engineering skills for AI coding agents — dbt, Airflow, Dagster, Prefect, Spark, Snowflake, BigQuery, Databricks, Kafka, Iceberg. Portable SKILL.md Agent Skills (the format Anthropic launched as Claude Skills), with idempotency, backfill, and data-quality know-how. Runs in Claude Code, Cursor, Codex, Copilot, Gemini CLI and more.