All repos — GH Trending Explorer

A Scala API for Apache Beam and Google Cloud Dataflow.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

marimo-team / marimo

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

retejs / rete

JavaScript framework for visual programming

OpenDCAI / DataFlow

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

samuelmtimbo / unit

Next Generation Visual Programming System

dora-rs / dora

DORA (Dataflow-Oriented Robotic Architecture) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.

TimelyDataflow / timely-dataflow

A modular implementation of timely dataflow in Rust

joernio / joern

Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc

nextflow-io / nextflow

A workflow language for data-driven computational pipelines

alldatacenter / alldata

🔥🔥 AllData可定义数据中台，以数据平台为底座，以数据中台为桥梁，以机器学习平台为工厂，以大模型应用为上游产品，提供全链路数字化解决方案。产品正式演示体验、社群咨询、商务采购：https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo

GoogleCloudPlatform / professional-services

Common solutions and tools developed by Google Cloud's Professional Services team. This repository and its contents are not an officially supported Google product.

TimelyDataflow / differential-dataflow

An implementation of differential dataflow using timely dataflow on Rust.

Bearer / bearer

Code security scanning tool (SAST) to discover, filter and prioritize security and privacy risks.

apache / hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.