OpenBMB / VoxCPM
git clone https://github.com/OpenBMB/VoxCPM.git
2.0.3 Β· 5mo ago
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
+14
stars, 24h Β· #1,067
+~98
stars, 7 days Β· #1,308
+~420
stars, 30 days Β· #1,261
40k
β
total Β· +0% this week
4.5k
forks Β· 135 open issues
Star history (as recorded here)
LanguagePython
LicenseApache-2.0
Created2025-09-16 (1y ago)
Last push14d ago
Watchers167
OwnerOrganization
GitHub topics
audiodeeplearningminicpmmultilingualpythonpytorchspeechspeech-synthesistext-to-speechttstts-modelvoice-cloningvoice-designvoxcpm
Links
- GitHub: github.com/OpenBMB/VoxCPM
- Homepage: https://voxcpm.com
- Releases Β· Issues Β· Hacker News mentions
README excerpt
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning English | δΈζ π Join our community for discussion and support! Feishu Β |Β Discord Β |Β π MiniCPM Wiki VoxCPM is a **tokenizer-free** Text-to-Speech system that directly generates continuous speech representations via an end-to-end **diffusion autoregressive architecture**, bypassing discrete tokenization to achieve highly natural and expressive synthesis. **VoxCPM2** is the latest major release β a **2B** parameter model trained on **over 2 million hours** of multilingual speech data, now supporting **30 languages**, **Voice Design**, **Controllable Voice Cloning**, and **48kHz** studio-quality audio output. Built on a MiniCPM-4 backbone. ### β¨ Highlights - π **30-Language Multilingual** β Input text in any of the 30 supported languages and synthesize directly, no language tag needed - π¨ **Voice Design** β Create a brand-new voice from a natural-language description alone (gender, age, tone, emotion, pace β¦), no reference audio required - ποΈ **Controllable Cloning** β Clone any voice from a short reference clip, with optional style guidance to steer emotion, pace, and expression while preserving the original timbre - ποΈ **Ultimate Cloning** β Reproduce every vocal nuance: provide both reference audio and its transcript, and the model continues seamlessly from the reference, faithfully preserving every vocal detail β timbre, rhythm, emotion, and style (same as VoxCPM1.5) - π **48kHz High-Quality Audio** β Accepts 16kHz reference audio and directly outputs 48kHz studio-quality audio via AudioVAE V2's asymmetric encode/decode design, with built-in super-resolution β no external upsampler needed - π§ **Context-Aware Synthesis** β Automatically infers appropriate prosody and expressiveness from text content - β‘ **Real-Time Streaming** β RTF as low as ~0.3 on NVIDIA RTX 4090, and ~0.13 accelerated by Nano-vLLM or vLLM-Omni β official vLLM omni-modal serving for VoxCPM2 with PagedAttention and an OpenAI-compatible API - π **Fully Open-Source & Commercial-Ready** β Weights and code released under the Apache-2.0 license, free for commercial use **π Supported Languages (30)** Arabic, Burmese, Chinese, Danish, Dutch, English, Finnish, French, German, Greek, Hebrew, Hindi, Indonesian, Italian, Japanese, Khmer, Korean, Lao, Malay, Norwegian, Polish, Portuguese, Russian, Spanish, Swahili, Swedish, Tagalog, Thai, Turkish, Vietnamese Chinese Dialect: εε·θ―, η²€θ―, ε΄θ―, δΈεθ―, ζ²³εθ―, ιθ₯Ώθ―, ε±±δΈθ―, 倩ζ΄₯θ―, ι½εθ― ### News - **[2026.04]** π₯ We release **VoxCPM2** β 2B, 30 languages, Voice Design & Controllable Voice Cloning, 48kHz audio output! Weights | Docs | Playground | Technical Report - **[2025.12]** π Open-source **VoxCPM1.5** weights with SFT & LoRA fine-tuning. (**π #1 GitHub Trending**) - **[2025.09]** π₯ Release VoxCPM Technical Report. - **[2025.09]** π Open-source **VoxCPM-0.5B** weights (**π #1 HuggingFace Trending**) --- ## Contents - Quick Start - Inst