πŸ“ˆ GH Trending Explorer 🎲 Surprise me

Search: iceberg Β· Language: Python Β· clear

schumannx / full-stack-data-engineering

End-to-end streaming data platform on AWS: Kafka β†’ Iceberg lake β†’ Kimball model β†’ Athena, orchestrated with Airflow 3. Terraform, Glue PySpark, dbt.

β˜… 146 Python 2mo ago
parqdb-io / parqdb

Billion-scale embedded vector database built entirely on Parquet and Arrow.

β˜… 102 Python today
Unknown-333 / awesome-data-engineering-skills

36 data-engineering skills for AI coding agents β€” dbt, Airflow, Dagster, Prefect, Spark, Snowflake, BigQuery, Databricks, Kafka, Iceberg. Portable SKILL.md Agent Skills (the format Anthropic launched as Claude Skills), with idempotency, backfill, and data-quality know-how. Runs in Claude Code, Cursor, Codex, Copilot, Gemini CLI and more.