vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

jundot / omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

jiji262 / douyin-downloader

A practical Douyin downloader for both single-item and profile batch downloads, with progress display, retries, SQLite deduplication, and browser fallback support. 抖音批量下载工具，去水印，支持视频、图集、合集、音乐(原声)。

jaikydota / kk-mix

Windows 批量视频混剪工具，15 项批处理功能 | A Windows batch video editing toolkit — 15 batch operations.

TacoTakumi / VoiceManager

A low latency streaming STT / STT server to add a voice to your LLM. Also supports batch mode.

pathwaycom / pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

raullenchai / Rapid-MLX

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.

Blueforcer / ComfyUI-DLSS5-Enhancer

NVIDIA DLSS 5 Neural Rendering (NGX feature 18) as ComfyUI nodes. Enhance image batches and video files with the real neural renderer, with optional upscaling.

canberk7 / ema-lightning

Tiny, fast and accurate Turkish text-to-speech. 8.6M parameters, 0.92% WER on Freya-TR-Eval, first audio in ~4 ms and 1,300× real time on one GPU. Streams audio, batches many callers on one GPU, and runs offline on a GPU or CPU.

spotify / luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

Lightning-AI / LitServe

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

waybarrios / vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

lij768423-svg / grok-register-panel

Grok 批量注册 (Camoufox) + 实时 Web 监控面板 | Batch Grok registration engine with live panel — concurrency · ASN blacklist · proxy pool · token auth

thisal-d / pytube-downloader

Simple. Fast. Powerful YouTube Downloader For Mac, Windows & Linux.

ibrahimqureshae / mdflux

Turn any document into clean, AI-ready Markdown. Local-first desktop app: reads scanned PDFs, batches folders, runs offline, and uses far fewer tokens than vision models.

feyzilim / clipfactory

Topic + template → short vertical video from your own B-roll: AI script, voice, scene plan, captions, FFmpeg render. Multi-persona, AI shot lists, AI B-roll, batch generation. Source-available (Elastic 2.0).

NaiveAI-Labs / NaiveRT

NaiveRT: a self-contained TP8 inference runtime for the Naive N series on eight Blackwell GPUs with UMMA support. One persistent CUDA graph per rank runs draft, eight-row verify, top-p sampling and cache commit with no host in the loop: 1,700 tokens/s at batch size 1, one-second peaks above 2,000.

vow132 / outlook-auto-register

Outlook registration and account operations console with proxy pool, batch jobs, and monochrome glass UI

mapillary / inplace_abn

In-Place Activated BatchNorm for Memory-Optimized Training of DNNs

volotat / mini-AGI

Continual learning model trained from scratch on 8GB VRAM laptop with batch-1 stream of data.

daimon3332 / OutlookRegister

Outlook/Hotmail account batch registration tool. Outlook / Hotmail 账号批量注册工具，支持自动获取 OAuth2 refresh_token

jkwill87 / mnamer

media file renaming and organizing tool

jarun / imgp

:camera_flash: Fast batch image resizer and rotator

hail-is / hail

Cloud-native genomic dataframes and batch computing

google / jaxopt

Hardware accelerated, batchable and differentiable optimizers in JAX.

dimastatz / whisper-flow

Whisper-Flow is a framework designed to enable real-time transcription of audio content using OpenAI’s Whisper model. Rather than processing entire files after upload (“batch mode”), Whisper-Flow accepts a continuous stream of audio chunks and produces incremental transcripts immediately.

mosecorg / mosec

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

rtunazzz / hidemyemail-generator

Bulk-generate iCloud Hide My Email addresses. Native macOS app and cross-platform CLI with batch generation, scheduling, a local inbox with code extraction, as well as iCloud China support.

leblancfg / autocrop

📸 Automatically detects and crops faces from batches of pictures.

kevinzakka / mjbatch

A Python library for running thousands of MuJoCo simulations in parallel on CPU

zengxiao-he / tessera

From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.

guillermo-navas-palencia / optbinning

Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.

TorchSim / torch-sim

Torch-native, batchable, atomistic simulations.

EveningStudy / asmr-dubber

日语／英语／中文音视频 → 中文/英文配音与字幕。支持音色克隆、双语混音、RTF 空间处理、人声分离、批量处理和仅字幕导出。JA/EN/ZH media → Chinese/English dubbing & subtitles. Voice cloning, bilingual mixing, RTF spatial processing, vocal separation, batch processing & subtitle-only export

Soniavasseur / Wallet-Risk-Scanner

Multi-chain crypto wallet risk scanner for AML/KYT screening. Scores addresses 0–100 using sanctions, risky contracts and fund tracing. Integrates 6 intelligence providers with failover, detects scams, hacks, mixers and phishing, supports 15+ chains, batch screening and TXT/JSON/CSV/HTML/PDF reports. Python, cross-platform.

zwliJay / jev-forge

An open training and inference stack for Jev-style decision models. Train models to score dynamic candidate branches from a shared prefix, with support for high-cardinality choice, calibration, and fast batched inference.

daimon3332 / OutlookManage

Outlook/Hotmail local account management WebUI supports batch account import, status detection (alive/banned), token refresh and synchronization.Outlook / Hotmail 本地账号管理 WebUI，支持账号批量导入、状态检测（存活/封禁）、令牌刷新与同步。

Mengqi-Lei / texglot

Translate arXiv papers and LaTeX projects with your own LLM API, preserving equations, citations, and document structure. Generate translated PDFs and editable source through a local app or batch CLI.

libnyx / LT2MD

AI-agent skill producing reusable Markdown from PDFs. It turns flowcharts, diagrams, and charts into text beside each caption instead of empty links. It checks an earlier conversion against the PDF and fixes misread or missing parts. Long PDFs run in small saved batches with an independent review pass, each paragraph tagged with its page.

chengyi-ai / douyin-image-post-scheduler

Codex Skill for batching, scheduling, and verifying Douyin image posts.

DrLiUsLab / particle-trajectory-visualization

Automatic multi-particle trajectory tracking and batch statistics from image sequences.

hclivess / whisperer

Batch subtitle generator GUI for video/audio — Whisper via faster-whisper or whisper.cpp (PySide6)

liwushu128-debug / grade-images

Grade Image / Grade Images — deterministic, non-generative photo color grading and RAW development for Codex with strict structure, identity, and texture preservation.

nevertoday / xxd-strip-ai-meta

Batch-remove AI provenance and image metadata with ExifTool. CLI + Agent Skill, preserving pixel data.

phineasaldridge / gpt-image-2-batch-generation

Argolink-focused batch image generation with bounded concurrency for GPT Image 2.

yibeigen / wechat-article-exporter

全网博文批量下载与知识提纯器 · 微信公众号/知乎/微博/CSDN/掘金文章一键导出为 Markdown、PDF、离线网页、Word 与 TXT 电子书 | Blog & WeChat Article Batch Exporter to PDF/Markdown

sgoedecke / system-one

Batched single-token choice inference for open language models, compatible with TypeSafe

drowzeys / keys-SM121-Optimized-MiniMax-H3-Nvidia-Sol-Engine-Kijai-SolAttn_Triton-Single-DGX-Spark

MiniMax-H3 33B audio+video DiT accelerated 1.54x on a single NVIDIA DGX Spark (GB10, sm_121): NVIDIA Sol-Engine FirstBlockCache + batched VAE decode ported to single-GPU ComfyUI, Sol-Attn patched for compute 12.1, kijai Triton INT8/TMA kernels. Benchmarks, charts, one-shot installer, agent recipe.

SoundsGoodAI / fast-gpu-asr

High-throughput batched ASR for NVIDIA GPUs. Run Zipformer and NVIDIA NeMo Parakeet models through one Python API with TensorRT, custom CUDA plugins, GPU beam search, and word timestamps - up to 25,000 RTFx on B300.

hazynyx / yt-mpeg-gui

A modern, high-performance dark-themed Windows desktop GUI combining yt-dlp & FFmpeg for fast 4K video downloading, audio extraction, live pause/resume, batch queues, and 1-click engine updates.

Garionhk / RTX-VSR-Studio

Windows GUI and CLI for upscaling video with NVIDIA RTX Video Super Resolution (no ComfyUI or PyTorch needed). Resumable segments for long films, batch queue, before/after preview, 720p–4K presets that keep aspect ratio, H.264/HEVC/ProRes/DNxHR output, never overwrites.

Vure-sh / crunchyroller

Fast Crunchyroll downloader & anime downloader (Web GUI & CLI) to download anime with multi-audio, soft subtitles, download queue, and Widevine DRM into MKV.

isHarryh / Ark-Unpacker

Arknights Game AB Assets Batch Unpacker | 明日方舟游戏资源批量解包器

jamespolyakov9829 / captcha-api

Captcha-solving API client - Cloudflare Challenge and Turnstile in one interface, with cost tracking and concurrent batch solves.