PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
PrefectHQ / prefect
dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
dograh-hq / dograh
Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.
NVIDIA / DALI
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
DaKheera47 / job-ops
job-ops: DevOps principles applied to job hunting. A self-hosted pipeline to track, analyze, and assist your application process
Ontos-AI / knowhere
Knowhere extracts, parses, and outputs structured chunks ready for AI Agents and RAG.
lynote-ai / humanize-text
Open-source pipeline for rewriting AI-generated text into natural human prose. Need it in your app? Try the Lynote Humanizer API → lynote.ai/ai-humanizer-api
TianyuCodings / NanoJev
A nano replica of Jev: parallel decisions, dynamic candidates, and an end-to-end training pipeline.
awawa-dev / HyperHDR
Next-gen open source ambient lighting system featuring a high-precision floating-point color pipeline breaking legacy RGB 24-bit limits. Includes advanced smoothing with inertia and adaptive temporal dithering for perfectly fluid, stable output to LEDs from any SDR or HDR video source. Supports Windows, macOS and Linux (x86/ARM).
CyberAgentGameEntertainment / NovaShader
Multi-functional shader for the Particle System that supports Universal Render Pipeline (URP) of Unity.
RosettaCommons / foundry
Central repository for biomolecular foundation models with shared trainers and pipeline components
juicesharp / rpiv-mono
Monorepo for @juicesharp/rpiv-* Pi plugins (lockstep versions, single install, single publish pipeline)
smg-project / smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
svenshi / oxidns
A high-performance, programmable DNS engine in Rust with flexible pipeline-based routing.
sudoprivacy / sudocode
Rust-native CLI coding agent for hackers — terminal-native, pipe-composable, scrollback-safe. Built because Claude Code chose non-coders.
EGSECDA / vocaloid-style-mv-pipeline
Production pipeline and Claude Code skill for Vocaloid-style hand-drawn (手書き) lyric music videos: deterministic Canvas2D/WebGL2 animation engine, JIZURA lyric motion, AI illustration, Blender toon 3D, headless rendering to 16:9 and 9:16.
physicalvision / artisan
Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark
aashish254 / Aniflow
🎬 Autonomous AI Studio for Manhwa & Webtoon Recaps — Vision Pipeline (YOLOv8 + Magi v2), Multi-Voice TTS & Video Synthesis
pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
deepspeedai / DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
openobserve / openobserve
Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.
airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
debezium / debezium
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
projectdiscovery / httpx
httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
wwmm / easyeffects
Limiter, compressor, convolver, equalizer and auto volume and many other plugins for PipeWire applications
risingwavelabs / risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
bentoml / BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
teamchong / pxpipe
cut Claude Code token usage by rendering text context as images
datajuicer / data-juicer
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
karlstav / cava
Cross-platform Audio Visualizer
Marker-Inc-Korea / AutoRAG
Your Personal Librarian Agent. Ask anything on your computer, organize files, remember important info and files.
bruin-data / ingestr
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
nextflow-io / nextflow
A workflow language for data-driven computational pipelines
jipraks / yt-short-clipper
Windows desktop app that turns long-form YouTube videos into 9:16 short-form clips — AI highlight detection, face-tracking portrait reframe, and word-by-word captions.
nvidia-isaac / video_to_data
Nvidia Isaac Video to Data Pipeline
yuxino / Mimi
把电脑或麦克风声音转成实时翻译字幕。Live translated subtitles from computer or microphone audio.
GuanYixuan / pyCapCut
A lightweight, flexible, and easy-to-use Python tool for generating CapCut drafts to build automated video editing/remix pipelines! Another similar project: https://github.com/GuanYixuan/pyJianYingDraft
RUSEGAL / ruseon-core
Edge video infrastructure in Go for CCTV — RTSP ingest, HLS/WebRTC streaming, fMP4 recording, timeshift and AI metadata pipelines.
equalang-ai / awesome-translation-tools
A curated directory of translation tools and workflows across travel, web reading, formatted documents, academic research, open-source local engines, and developer pipelines.
itsnik-scrpt / FigmaBridge
Figma-to-Engine UI Pipeline: Figma Auto-Layout → Unity UI Toolkit (UMG & Godot on roadmap) via WebSocket hot-reload and an IR layout compiler
hpcaitech / ColossalAI
Making large AI models cheaper, faster and more accessible
jenkinsci / jenkins
Jenkins automation server
pypa / pipenv
Python Development Workflow for Humans.
apache / shardingsphere
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
spotify / luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
argoproj / argo-workflows
Workflow Engine for Kubernetes
Unstructured-IO / unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
streamlink / streamlink
Streamlink is a CLI utility which pipes video streams from various services into a video player
kubescape / kubescape
Kubescape is an open-source Kubernetes security platform for your IDE, CI/CD pipelines, and clusters. It includes risk analysis, security, compliance, and misconfiguration scanning, saving Kubernetes users and administrators precious time, effort, and resources.
PipedreamHQ / pipedream
Connect APIs, remarkably fast. Free for developers.
openspug / spug
Spug is a lightweight agent-free automatic operation and maintenance platform designed for small and medium-sized enterprises. It integrates host management, host batch execution, host online terminal, file management, application release and deployment, pipelines, online task planning, configuration center, monitoring, alarm and so on.
PRQL / prql
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
OpenPipe / ART
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
TeamPiped / Piped
An alternative privacy-friendly YouTube frontend which is efficient by design.
tektoncd / pipeline
A cloud-native Pipeline resource.
google-deepmind / alphafold3
AlphaFold 3 inference pipeline.
OpenDCAI / DataFlow
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
concourse / concourse
Concourse is a container-based automation system written in Go. It's mostly used for CI/CD.
flyteorg / flyte
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)