ConduitIO / conduit
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
ConduitIO / conduit
dbt-labs / dbt-mcp
A MCP (Model Context Protocol) server for interacting with dbt.
kimtth / software-architect-mindmap
🧠Mindmap of 🗺️Software Architecture, Software engineering: An Overview of Software Terminologies and Concepts.
Desbordante / desbordante-core
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
Hebbian-Robotics / hflow
SDK for robotics teams to verify the quality of their data used for AI model training.
jddevtime / open-lakehouse-compute-fabric
Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.
ashishsinha1602 / schemagate
Text-to-SQL access control: schema selection that gives the LLM only the tables the caller is allowed to read. Row-level-security-aware table pruning for LangChain, MCP and any SQL agent. Postgres, Oracle, MySQL, SQL Server. 75% fewer prompt tokens.
EmbrasureAI / flow
Stream PostgreSQL changes into standard Apache Iceberg tables, built in Rust.
Snowflake-Labs / data-eng-bench
Data-engineering benchmark for coding agents (DuckDB + Snowflake dbt tasks).
MrXujiang / opne-aureka
Upload spreadsheets, ask questions via chat, and auto-generate chart reports. No coding required, gain instant insights and unlock data value effortlessly. ｜上传表格，像聊天一样提问，系统自动分析生成图表报告。无需编程，即时洞察，数据价值触手可及。
maurinruneacco / luau-diagrams-and-defects
Production Data Engineering Cloud Architecture Workflow Automation Portfolio 2026
darshilparmar / zomato-ai-data-engineering-end-to-end-project
zomato-ai-data-engineering-end-to-end-project
GetCassis / analytics-agent-articles
A curated list of articles from data teams building analytics agents.
homosaaa / homosaaa-data-engineering-roadmap
Data Engineering Mentorship Program — A structured roadmap for SQL, Python, Data Warehousing, Data Modeling, and Cloud fundamentals.
northgraindata / dsui
Open-source, extensible platform for your data stack. Connect tools, install plugins, and build custom capabilities.
Victor-Kipruto-Rop / Data-Engineering-Template-
—
Unknown-333 / awesome-data-engineering-skills
36 data-engineering skills for AI coding agents — dbt, Airflow, Dagster, Prefect, Spark, Snowflake, BigQuery, Databricks, Kafka, Iceberg. Portable SKILL.md Agent Skills (the format Anthropic launched as Claude Skills), with idempotency, backfill, and data-quality know-how. Runs in Claude Code, Cursor, Codex, Copilot, Gemini CLI and more.
dlt-hub / dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️