vits2 backbone with multilingual-bert
All-in-One Development Tool based on PaddlePaddle
On-device wake word detection powered by deep learning
Open-source meeting transcription API for Google Meet, Microsoft Teams & Zoom. Auto-join bots, real-time WebSocket transcripts, MCP server for AI agents. Self-host or use hosted SaaS.
Lingvo
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
Desktop AI Assistant powered by GPT, Gemini, Claude, Grok, Ollama, DeepSeek, Perplexity, and more - chat, agents, tools, MCP, plugins, RAG, vision, voice, image and video generation, speech synthesis and speech recognition, web search, memory, presets, canvas, assistants, themes, computer use. Windows, Linux, and Mac.
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
AuK: An Open-Source Foundational Model for Speech Generation and Editing
MTools 是一个功能强大的多功能桌面应用程序,集成了音视频处理、图片编辑、文本操作和编码工具,内置AI增强功能,并提供本地 MCP 服务。旨在简化您的工作流程,提升生产效率
Open-source voice-AI SDK. The Vapi/Retell alternative for builders who want to own the stack. Give your AI agent a phone number in 4 lines — Python and TypeScript, MIT licensed, Twilio, Telnyx, and Plivo.
Voice Operation and Design Engine with Reproduction capabilities
Give AI agents eyes, ears, and verifiable results. Watch Skill turns video, audio and screen activity into searchable, timestamped evidence and proves work with deterministic contracts, not model opinion. DeepWatch is the agent workspace built on DeepSeek Harness. Python + npm, MCP, CLI, REST, Web.
An 8M-parameter English text-to-speech model distilled from Kokoro-82M. 9 MB, runs 18x real time on one CPU thread.
Windows 微信 4.1.12+ 聊天记录本地导出工具:TXT / Markdown / JSON,支持图片、文件、语音、视频、本地语音转文字和聊天预览,面向 GPT、Claude、Gemini 等 LLM。 | Local-first WeChat chat exporter for LLMs.
Hermes Talk: realtime duplex voice for Hermes Agent. Rides your ChatGPT or X Premium subscription, no API key needed. OpenAI, Grok, Gemini. Terminal, Discord, dashboard.
A tool that allows AI to direct the dubbing process, uses the original actor voices and does the audio generation on your local PC
ConversationalVoice: Full-Duplex Speech Data from Real Conversations
SemBridge: Semantic Token Anchoring for Continuous-Latent Autoregressive Speech Generation
Real-time Windows system-audio translation captions for Chinese, Japanese, English, and Korean, with optional LLM revision.
Agent Skill for Equalang: translate PDF, DOCX, PPTX, XLSX, EPUB, subtitles, pictures, audio and video with the layout kept; transcribe recordings. For Claude Code, Codex, Cursor and more.
ASR bridge exposing Weixin voice input as a programmable speech transcription API on Windows
End-to-End Speech Processing Toolkit
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
so-vits-svc fork with realtime support, improved interface and more features.
ModelScope: bring the notion of Model-as-a-Service to life.
A nearly-live implementation of OpenAI's Whisper.
Converts text to speech in realtime
A simple, high-quality voice conversion tool focused on ease of use and performance.
Data manipulation and transformation for audio signal processing, powered by PyTorch
The PyTorch-based audio source separation toolkit for researchers
Topic → 4K narrated video for coding agents. v5.3.0: local TTS (edge free + azure, no external engine), manifest-based Asset Engine, Remotion composition, cost-gated AI generation, Bilibili/YouTube/Xiaohongshu/Douyin/WeChat Channels
PALLAIDIUM — a generative AI movie studio, seamlessly integrated into the Blender Video Editor (VSE), enabling end-to-end production from script to screen and back.
Controllable Transcription. Verbatim ( every, filler, pause, stutter, vocal sound) , or intended ( what the speaker meant to say, optimized for readability) with word-level timestamps.
Multi-backend whisper app. Blazing fast. Mac-arm optimized. Easy install. Input a local file or url and this service will transcribe it using Whisper AI. Completely private and Free 🤯🤯🤯
Real-time text-to-speech with Qwen3-TTS
Whisper command line client compatible with original OpenAI client based on CTranslate2.
Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.
Offline inference engine for art, real-time voice conversations, LLM powered chatbots and automated workflows
Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers.
Native speech-to-text for Linux - Fast, accurate, private, and hackable system-wide dictation
A ComfyUI custom node integration for local multi-engine multi-language Text-to-Speech and Voice Conversion. Supports: RVC, Echo-TTS, Qwen3-TTS, Cozy Voice 3, Step Audio EditX, IndexTTS-2, Chatterbox (classic and multilingual), F5-TTS, Higgs Audio 2, 3, and VibeVoice with unlimited text length, SRT timing, Character support, and many audio tools
A GUI tool for offline transcription of speech recordings, including speaker diarization, utilizing state-of-the-art machine learning models.
Tools for handling multimodal data in machine learning projects.
Microsoft Text-to-Speech API Samples
A python based desktop voice assistant capable of executing system-level commands, integrating speech recognition and text-to-speech, and handling asynchronous user interactions.
Whisper-Flow is a framework designed to enable real-time transcription of audio content using OpenAI’s Whisper model. Rather than processing entire files after upload (“batch mode”), Whisper-Flow accepts a continuous stream of audio chunks and produces incremental transcripts immediately.
:robot::speech_balloon: An easy-to-use and highly extensible IRC Bot framework. Formerly Willie.
The hub for audio AI research: papers, open models, benchmarks & datasets across audio LLMs, speech recognition, TTS, music & audio generation.
Free, open-source, 100% offline voice dictation for Linux. Speak and type anywhere via whisper.cpp, Whisper & VOSK engines, GPU-accelerated, works on X11 + Wayland!
Optimized Whisper models for streaming and on-device use
An Omni Real-Time Assistant for Everyone
Vui Nano — a small, context-aware text-to-speech model trained on real conversations. 219M active params (305M total), Apache 2.0, voice cloning, streaming, runs on CPU (dependency-free C build). Ships with a full real-time voice assistant: WebRTC, ASR, local LLM, OpenAI Realtime API compatible.
On-device Speech-to-Intent engine powered by deep learning
speech to text benchmark framework
On-device streaming speech-to-text engine powered by deep learning
Automatically Update Text-to-speech (TTS) Papers Daily using Github Actions (Update Every 12th hours)
Turn PDFs and EPUBs into audiobooks; subtitles or videos into dubbed videos (including translation), and more. For free. Pandrator uses local models, including voice-cloning (instant, RVC-enhanced, XTTS fine-tuning) and LLM processing. It aspires to be a user-friendly app with a GUI, an installer and all-in-one packages.
ComfyUI custom node for the VibeVoice TTS. Expressive, long-form, multi-speaker conversational audio