Local AI BGM and sound effects for Claude Code and any MCP client. Stable Audio 3 on Apple Silicon (MLX) and Windows NVIDIA GPUs (PyTorch). No cloud, no API key.
Claudemy: an open-source alternative to Udemy and Coursera. Give Claude a topic, it researches the web and builds a course of 2-minute audio lessons with cited sources. A free Claude Code skill.
CVAT is a leading data annotation platform for image, video, audio, and 3D datasets. It offers open-source, cloud, and enterprise products, as well as labeling services, with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
A PyTorch-based Speech Toolkit
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
A framework for efficient model inference with omni-modality models
Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Generative models for conditional audio generation
Data manipulation and transformation for audio signal processing, powered by PyTorch
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
The PyTorch-based audio source separation toolkit for researchers
The collection of pre-trained, state-of-the-art AI models for ailia SDK
Cutting edge AI technology for automated audio transcription. A nice GUI for OpenAIs Whisper and pyannote (speaker identification)
LedFx is a network based LED effect engine designed to deliver advanced real-time audio effects to a wide variety of devices.
JoyAI-Echo-1.5: Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds
Local video editor for coding agents: 42 FFmpeg tools with a machine-readable contract and an MCP server, for Claude Code, Cursor and Codex. Cut, captions, reframe, loudness, platform exports. No cloud, no API keys.
💬 An extensive collection of exceptional resources dedicated to the captivating world of talking face synthesis! ⭐ If you find this repo useful, please give it a star! 🤩
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
High quality training free inpaint for every stable diffusion model. Supports ComfyUI
Self hosted file converter and compression tool for images, video, audio, json, excel and more. Supports over 3,000 conversions!
Easy to use stem (e.g. instrumental/vocals) separation from CLI or as a python package, using a variety of amazing pre-trained models (primarily from UVR)
[NeurIPS2026] We present StableAvatar, the first end-to-end video diffusion transformer, which synthesizes infinite-length high-quality audio-driven avatar videos without any post-processing, conditioned on a reference image and audio.
A ComfyUI custom node integration for local multi-engine multi-language Text-to-Speech and Voice Conversion. Supports: RVC, Echo-TTS, Qwen3-TTS, Cozy Voice 3, Step Audio EditX, IndexTTS-2, Chatterbox (classic and multilingual), F5-TTS, Higgs Audio 2, 3, and VibeVoice with unlimited text length, SRT timing, Character support, and many audio tools
—
Real-time audio visualizations (spectrum, spectrogram, etc.)
A foundation model that generates synchronized video and audio in a single model
Realtime audio analysis in Python to extract audio features from streaming audio and send them over OSC to any client app.
660+ muapi-hosted generative-media models plus community-submitted third-party API tools (SEO, enrichment, social, scraping) — one YAML file per entry, browsable by capability.
Fun-Audio-Chat is a Large Audio Language Model built for natural, low-latency voice interactions.
The hub for audio AI research: papers, open models, benchmarks & datasets across audio LLMs, speech recognition, TTS, music & audio generation.
A comprehensive open-source 3A game-generation skill and asset framework.
—
Training-free Spectrum acceleration for ComfyUI’s native MiniMax H3 audio-video model. Uses Chebyshev ridge feature forecasting to skip selected H3 transformer evaluations, with adaptive scheduling, sampler-aware support for Euler, ER-SDE, RES, SEEDS and SA-Solver, CPU/VRAM history storage, and fail-closed native fallbacks.
🪐 HelixWorld: real-time interactive audio-visual world model.
Human + AI music production workflow for Suno - skills, templates, and tools
Open-source end-to-end omni interaction agent for natural full-duplex voice collaboration, continuous audio-visual perception, and asynchronous long-horizon agentic execution.
Genblaze is an open source Python SDK for orchestrating generative AI media pipelines across video, audio, and image providers with built in provenance for every output.
a real-time digital-human model for long-form audio-video generation
Give AI agents eyes, ears, and verifiable results. Watch Skill turns video, audio and screen activity into searchable, timestamped evidence and proves work with deterministic contracts, not model opinion. DeepWatch is the agent workspace built on DeepSeek Harness. Python + npm, MCP, CLI, REST, Web.
A confirmation-gated Codex and WorkBuddy skill for audio-first image-story video production.
TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming
Democratizing Native Audio-Video Generation at 2K Resolution
A remixer for the Elektron Octatrack's OS: modules (custom DSP56300 effects, ColdFire mods, ports of community mods) composed into one firmware image built from your own 1.40C. No firmware distributed.
日语/英语/中文音视频 → 中文/英文配音与字幕。支持音色克隆、双语混音、RTF 空间处理、人声分离、批量处理和仅字幕导出。JA/EN/ZH media → Chinese/English dubbing & subtitles. Voice cloning, bilingual mixing, RTF spatial processing, vocal separation, batch processing & subtitle-only export
Local-first high-quality offline RVC voice conversion workstation
Upscale long, high-resolution MiniMax H3 video on a VRAM-limited GPU in a single node.
ComfyUI custom nodes for MiniMax H3 audio-video conditioning and reference workflows.
Official Implementation of AptAvatar: Fast and Vivid Long-Form Audio-Driven Video Generation for Production-Ready Avatars
Synthesizing, Benchmarking, and Training for Native Audio-Visual Dialogue
Ultrafast Qwen3-TTS: sub-50 ms time-to-first-audio at 10 requests per second.
Imagination Studio by keys+Wasserman powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slate workflow by Sam Wasserman), render Qwen-Image-2.1 / FLUX3-K pictures and MiniMax H3 / FastH3 video with sound on TensorFold.
Official Fish Audio plugin for Hermes Agent: expressive text-to-speech, speech-to-text, voice library, cloning and voice design.
Agent skills for Sonilo's licensed music, sound-effects, dubbing, and audio-ducking API
—
Local-first AI meeting minutes workbench: FunASR speech-to-text + Ollama LLM, engineering-scene recognition, DOCX/PDF export, zero API keys, fully offline. 本地优先的智能会议纪要工作台:录音转写、场景识别、纪要导出全流程本地运行。
Fast, concurrent inference for YuE2. Same model and recipe: 1.68× faster per song, 3.31× more songs per GPU.
A unified audio-video variational autoencoder with cross-modal alignment for joint reconstruction and generation
Complete Production Environment for professional MiniMax Music 3 audio generation, including Prompt Generation, Metadata generation including Cover Art, Sound Enhancement to improve Minimax weaknesses, mastering, and saving in various file formats