apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

dagster-io / dagster

An orchestration platform for the development, production, and observation of data assets.

apache / seatunnel

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

bruin-data / ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

apache / hop

Hop Orchestration Platform

clidey / whodb

Where data access meets operational intelligence

slothflowlabs / duckle

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

airbytehq / airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

jitsucom / jitsu

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

seandavi / awesome-single-cell

Community-curated list of software packages and data resources for single-cell, including RNA-seq, ATAC-seq, etc.

apache / devlake

Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.

wgzhao / Addax

Actively maintained successor to Alibaba DataX — a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.

mage-ai / mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.

fluvio-community / fluvio

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

rudderlabs / rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

apache / flink-cdc

Flink CDC is a streaming data integration tool

DTStack / chunjun

A data integration framework

heathersherry / Knowledge-Graph-Tutorials-and-Papers

Insightful Tutorials and Papers about Knowledge Graphs

estuary / flow

🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊

saeyslab / nichenetr

NicheNet: predict active ligand-target links between interacting cells

immunogenomics / harmony

Fast, sensitive and accurate integration of single-cell data with Harmony

ConduitIO / conduit

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.

cloudquery / cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.