The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
The open document intelligence platform for builders and hackers - DMS for the agentic world
User friendly and accurate binder design pipeline
Self-hosted Chrome → NAS pipeline: capture HLS / DASH / MP4 streams from any site and download to your NAS. Single multi-arch Docker image (FastAPI + worker + ffmpeg) distributed via GHCR.
A lightweight, flexible, and easy-to-use Python tool for generating CapCut drafts to build automated video editing/remix pipelines! Another similar project: https://github.com/GuanYixuan/pyJianYingDraft
CTI Expert — Cyber Threat Intelligence & OSINT analysis skill for Claude Code / Codex. 120+ commands, 57 techniques, 79 typed MCP tools, deterministic case pipeline + ICD-203 reports. No API keys required for core.
poutine, a supply chain vulnerability scanner for build pipelines
Automated GitHub Actions pipeline that scrapes and publishes NFL datasets as releases for the nflverse R packages.
Local voice cloning + SRT-driven web presentations. Two installable Agent skills: script → voice → motion.
🏯 Silkroad Online v1.150 rebuilt end to end: a WebGPU browser client 🎮, a Go game server ⚔️ and the asset pipeline 🧰 that ties them together. Play in your browser.
OpenShorts (Kaipian) — open-source, local-first short-video pipeline: topic in, publish-ready video out (script → footage / on-device AI → TTS → captions → mp4). Free path costs $0, no key needed with local Ollama. Talking-head shorts + AI mini-drama. | 开片:开源、本地优先的短视频生产线,话题进、成片出,免费路径 0 元
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
Kubescape is an open-source Kubernetes security platform for your IDE, CI/CD pipelines, and clusters. It includes risk analysis, security, compliance, and misconfiguration scanning, saving Kubernetes users and administrators precious time, effort, and resources.
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
A cloud-native Pipeline resource.
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
📚 Parameterize, execute, and analyze notebooks
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
The only Kubernetes dashboard you need
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
Community-curated list of software packages and data resources for single-cell, including RNA-seq, ATAC-seq, etc.
Open source Structure-from-Motion pipeline
AI Infra / AI Orchestration / AI Control Plane
Unity Graphics - Including Scriptable Render Pipeline
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
【A common used C++ & Python DAG framework】 一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork & 交流
A Julia machine learning framework
Data intensive science for everyone.
Scalable data pre processing and curation toolkit for LLMs
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Lobster is a Openclaw-native workflow shell: a typed, local-first “macro engine” that turns skills/tools into composable pipelines and safe automations—and lets Openclaw call those workflows in one step.
List of open-source technologies that help in the process of building a pipeline for CG and VFX productions
Creates CycloneDX Bill of Materials (BOM) for your projects from source and container images. Supports many languages and package managers. Integrate in your CI/CD pipeline with automatic submission to Dependency Track server
MAC (Multi-Agent CAD): A decoupled multi-agent framework for text-to-CAD generation via constrained test-time compute
A Python implementation of the DESeq2 pipeline for bulk RNA-seq DEA.
Collaboration Platform for Animation and VFX Productions
Orchestrate complete 3D generation pipelines — from text-to-image, image editing, mesh generation, UV unwrapping, to texturing — all in a single visual workspace powered by ComfyUI and external APIs.
Agentic SDLC infrastructure. Define guardrails. Collect signals. Enforce continuously. Signed records of what your AI coding agents and CI/CD pipelines did, checked against policies as code, with the loop closed in CI/CD. AI sessions, SBOMs, VEX, SARIF and SLSA provenance, built on Sigstore and in-toto. Apache 2.0.
A curated collection of Open WebUI plugins - tools, skills, filters, pipes, actions and events that extend your AI chat experience.
Research pipelines as semantic execution units: each skill declares inputs/outputs, acceptance criteria, and guardrails. Evidence-first methodology prevents hollow writing through structured intermediate artifacts.
ArchUnitTS is an architecture testing library. Specify and ensure architecture rules in your TypeScript app. Easy setup and pipeline integration.
File-logged conversation protocol and on-demand development pipeline
Full Linux composition pipeline - source to binary
7 installable agent skills that run the pipeline behind $2M AI video productions — script to locked, generation-ready shot prompts. Claude Code · Codex · Hermes · OpenCode
Lecture recordings → structured grounded notes + a synced HTML viewer: video, timestamped transcript and curated summary on one page. Local GPU pipeline (Whisper ASR · slide extraction · OCR · VLM signals · capture-time alignment). Claude Code skill + plain CLI.
Pipeline that turns audio/video into Chinese subtitles: vocal separation → VAD/ASR → optional LLM correction, translation, and knowledge-assisted polish.
MCP management console for the official DeepSeek Harness MCP client: /mcp command with health diagnostics and pipeline trial calls, a Settings MCP tab with server CRUD (approval-gated writes, automatic backups) and a tool trial console over the official tool pipeline (Apache-2.0, dsh-plugin).
RL Token pipeline for the SO-101 arm: π0.5 fine-tuning, RL Token training, critical-phase classifier, online RL and deployment.
Claude skills for industry-standard Remotion motion graphics: klik-anim-bible (animation craft laws, standalone) + klik-remotion-method (end-to-end video production pipeline). Install one or both — see README.
Synthetic episode generation pipeline of the Agentic Real2Sim project.
Self-hosted voice gateway in Go that speaks the OpenAI Realtime (GA) WebSocket protocol and runs a cascaded ASR → LLM → TTS pipeline behind it. Keep clients unchanged while swapping speech and LLM providers at runtime
Voiced quest dialogue, zone lore and in-world books for World of Warcraft Forever/Classic — addons, the site behind them, and the pipelines that generate the audio.
WebGPU render pipeline: baked lightmap atlas + DDGI-style probe volume, three.js r182 / TSL
Claude Code plugin with 12 composable marketing skills: competitor research, content calendars, SEO briefs, ad copy, cold outreach, short-form video packages, and rules-aware community posting, plus a pipeline to publish via webhook or platform APIs.
A high-performance, offline game translation framework built in Python. Powered by CTranslate2 (INT8 quantization) and Helsinki-NLP neural models, this tool automates multi-language translation for game scripts while strictly protecting low-level syntax, variables, and memory pointers.
Agent skills that turn a song and its lyrics into a hand-painted watercolour music video (p5.brush + headless Chrome + ffmpeg), following PDoomVideo's pipeline
500+ DevOps, SRE, security, cloud, and platform engineering interview questions across 40 topics - short answer, detail, worked example, and interview tips for each.