spotify / scio
A Scala API for Apache Beam and Google Cloud Dataflow.
spotify / scio
hasura / graphql-engine
Blazing fast, instant realtime GraphQL APIs on all your data with fine grained access control, also trigger webhooks on database events.
getredash / redash
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
cube-js / cube
📊 Cube Core is open-source semantic layer for AI, BI and embedded analytics
Canner / WrenAI
GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.
googleapis / mcp-toolbox
MCP Toolbox for Databases is an open source MCP server for databases.
apache / doris
Apache Doris is a real-time analytics and hybrid search database for AI agents.
tobymao / sqlglot
Python SQL Parser and Transpiler
growthbook / growthbook
Open Source Feature Flags, Experimentation, and Product Analytics
ibis-project / ibis
the portable Python dataframe library
cloudquery / cloudquery
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
jitsucom / jitsu
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
googleapis / google-cloud-go
Google Cloud Client Libraries for Go.
rudderlabs / rudder-server
Privacy and Security focused Segment-alternative, in Golang and React
k1LoW / tbls
tbls is a CI-Friendly tool to document a database, written in Go.
bruin-data / ingestr
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
PeerDB-io / peerdb
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
GoogleCloudPlatform / professional-services
Common solutions and tools developed by Google Cloud's Professional Services team. This repository and its contents are not an officially supported Google product.
swirlai / swirl-search
AI Search & RAG Without Moving Your Data. Get instant answers from your company's knowledge across 100+ apps while keeping data secure. Deploy in minutes, not months.
elementary-data / elementary
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
EvgSkv / logica
Logica is a logic programming language that compiles to SQL. It runs on DuckDB, Google BigQuery, PostgreSQL and SQLite.
googleapis / google-cloud-java
Google Cloud Client Library for Java
getnao / nao
👾 nao is an open source analytics agent. (1) Create context with nao-core cli, (2) deploy nao chat interface for everyone
bruin-data / bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Multiwoven / multiwoven
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
quarylabs / sqruff
Fast SQL formatter/linter
GoogleCloudPlatform / DataflowTemplates
Cloud Dataflow Google-provided templates for solving in-Cloud data tasks
ClickHouse / ClickBench
ClickBench: a Benchmark For Analytical Databases
datacontract / datacontract-cli
Open-source data contract testing for Snowflake, Databricks, BigQuery, Kafka & 15 more. Built on the Open Data Contract Standard (ODCS). MIT.
dataform-co / dataform
Dataform is a framework for managing SQL based data operations in BigQuery
zakird / crux-top-lists
Downloadable snapshots of the Chrome Top Million Websites pulled from public CrUX data in Google BigQuery.
AltimateAI / altimate-code
Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.
HTTPArchive / almanac.httparchive.org
HTTP Archive's annual "State of the Web" report made by the web community
DataflareApp / dataflare
Simple, easy-to-use database manager
rominirani / financial-audit-agent-tutorial
Financial Audit Agent Team — A multi-agent reconciliation system built with Google Antigravity SDK & GCP (BigQuery, Cloud Storage, Cloud Logging)
Unknown-333 / awesome-data-engineering-skills
36 data-engineering skills for AI coding agents — dbt, Airflow, Dagster, Prefect, Spark, Snowflake, BigQuery, Databricks, Kafka, Iceberg. Portable SKILL.md Agent Skills (the format Anthropic launched as Claude Skills), with idempotency, backfill, and data-quality know-how. Runs in Claude Code, Cursor, Codex, Copilot, Gemini CLI and more.