πŸ“ˆ GH Trending Explorer 🎲 Surprise me

← all repos

OpenBMB / VoxCPM

git clone https://github.com/OpenBMB/VoxCPM.git 2.0.3 Β· 5mo ago

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

+14
stars, 24h Β· #1,067
+~98
stars, 7 days Β· #1,308
+~420
stars, 30 days Β· #1,261
40k
β˜… total Β· +0% this week
4.5k
forks Β· 135 open issues

Star history (as recorded here)

2026-10-20 Β· 39,632 β˜… 2026-10-22 Β· 39,780 β˜…
LanguagePython
LicenseApache-2.0
Created2025-09-16 (1y ago)
Last push14d ago
Watchers167
OwnerOrganization

GitHub topics

Links

README excerpt
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning 
 English | δΈ­ζ–‡ 
 πŸ‘‹ Join our community for discussion and support!
 Feishu
 Β |Β 
 Discord
 Β |Β 
 πŸ“š MiniCPM Wiki
VoxCPM is a **tokenizer-free** Text-to-Speech system that directly generates continuous speech representations via an end-to-end **diffusion autoregressive architecture**, bypassing discrete tokenization to achieve highly natural and expressive synthesis.
**VoxCPM2** is the latest major release β€” a **2B** parameter model trained on **over 2 million hours** of multilingual speech data, now supporting **30 languages**, **Voice Design**, **Controllable Voice Cloning**, and **48kHz** studio-quality audio output. Built on a MiniCPM-4 backbone.
### ✨ Highlights
- 🌍 **30-Language Multilingual** β€” Input text in any of the 30 supported languages and synthesize directly, no language tag needed
- 🎨 **Voice Design** β€” Create a brand-new voice from a natural-language description alone (gender, age, tone, emotion, pace …), no reference audio required
- πŸŽ›οΈ **Controllable Cloning** β€” Clone any voice from a short reference clip, with optional style guidance to steer emotion, pace, and expression while preserving the original timbre
- πŸŽ™οΈ **Ultimate Cloning** β€” Reproduce every vocal nuance: provide both reference audio and its transcript, and the model continues seamlessly from the reference, faithfully preserving every vocal detail β€” timbre, rhythm, emotion, and style (same as VoxCPM1.5)
- πŸ”Š **48kHz High-Quality Audio** β€” Accepts 16kHz reference audio and directly outputs 48kHz studio-quality audio via AudioVAE V2's asymmetric encode/decode design, with built-in super-resolution β€” no external upsampler needed
- 🧠 **Context-Aware Synthesis** β€” Automatically infers appropriate prosody and expressiveness from text content
- ⚑ **Real-Time Streaming** β€” RTF as low as ~0.3 on NVIDIA RTX 4090, and ~0.13 accelerated by Nano-vLLM or vLLM-Omni β€” official vLLM omni-modal serving for VoxCPM2 with PagedAttention and an OpenAI-compatible API
- πŸ“œ **Fully Open-Source & Commercial-Ready** β€” Weights and code released under the Apache-2.0 license, free for commercial use
**🌍 Supported Languages (30)** 
Arabic, Burmese, Chinese, Danish, Dutch, English, Finnish, French, German, Greek, Hebrew, Hindi, Indonesian, Italian, Japanese, Khmer, Korean, Lao, Malay, Norwegian, Polish, Portuguese, Russian, Spanish, Swahili, Swedish, Tagalog, Thai, Turkish, Vietnamese
Chinese Dialect: 四川话, η²€θ―­, 吴语, δΈœεŒ—θ―, 河南话, ι™•θ₯Ώθ―, 山东话, 倩ζ΄₯话, 闽南话
### News
- **[2026.04]** πŸ”₯ We release **VoxCPM2** β€” 2B, 30 languages, Voice Design & Controllable Voice Cloning, 48kHz audio output! Weights | Docs | Playground | Technical Report
- **[2025.12]** πŸŽ‰ Open-source **VoxCPM1.5** weights with SFT & LoRA fine-tuning. (**πŸ† #1 GitHub Trending**)
- **[2025.09]** πŸ”₯ Release VoxCPM Technical Report.
- **[2025.09]** πŸŽ‰ Open-source **VoxCPM-0.5B** weights (**πŸ† #1 HuggingFace Trending**)
---
## Contents
- Quick Start
 - Inst