RVC-Boss / GPT-SoVITS
git clone https://github.com/RVC-Boss/GPT-SoVITS.git
20250606v2pro · 1y ago
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)
+109
stars, 24h · #352
+~621
stars, 7 days · #351
+~2.7k
stars, 30 days · #316
64k
★ total · +1% this week
6.7k
forks · 901 open issues
Star history (as recorded here)
LanguagePython
LicenseMIT
Created2024-01-14 (2y ago)
Last push4d ago
Watchers287
OwnerUser
GitHub topics
Links
README excerpt
GPT-SoVITS-WebUI A Powerful Few-shot Voice Conversion and Text-to-Speech WebUI. **English** | **中文简体** | **日本語** | **한국어** | **Türkçe** --- ## Features: 1. **Zero-shot TTS:** Input a 5-second vocal sample and experience instant text-to-speech conversion. 2. **Few-shot TTS:** Fine-tune the model with just 1 minute of training data for improved voice similarity and realism. 3. **Cross-lingual Support:** Inference in languages different from the training dataset, currently supporting English, Japanese, Korean, Cantonese and Chinese. 4. **WebUI Tools:** Integrated tools include voice accompaniment separation, automatic training set segmentation, Chinese ASR, and text labeling, assisting beginners in creating training datasets and GPT/SoVITS models. **Check out our demo video here!** Unseen speakers few-shot fine-tuning demo: https://github.com/RVC-Boss/GPT-SoVITS/assets/129054828/05bee1fa-bdd8-4d85-9350-80c060ab47fb **RTF(inference speed) of GPT-SoVITS v2 ProPlus**: 0.028 tested in 4060Ti, 0.014 tested in 4090 (1400words~=4min, inference time is 3.36s), 0.526 in M4 CPU. You can test our huggingface demo (half H200) to experience high-speed inference . 请不要尬黑GPT-SoVITS推理速度慢,谢谢! **User guide: 简体中文 | English** **Zero-Shot TTS Speaker Similarity Comparison Image on SeedTTS Eval Testset_CN2020** ## Installation For users in China, you can click here to use AutoDL Cloud Docker to experience the full functionality online. ### Tested Environments | Python Version | PyTorch Version | Device | | -------------- | ---------------- | ------------- | | Python 3.10 | PyTorch 2.5.1 | CUDA 12.4 | | Python 3.11 | PyTorch 2.5.1 | CUDA 12.4 | | Python 3.11 | PyTorch 2.7.0 | CUDA 12.8 | | Python 3.9 | PyTorch 2.8.0dev | CUDA 12.8 | | Python 3.12 | PyTorch 2.7.1 | CUDA 11.8 | | Python 3.12 | PyTorch 2.7.1 | CUDA 12.8 | | Python 3.9 | PyTorch 2.5.1 | Apple silicon | | Python 3.11 | PyTorch 2.7.0 | Apple silicon | | Python 3.9 | PyTorch 2.2.2 | CPU | ### Windows If you are a Windows user (tested with win>=10), you can download the integrated package and double-click on _go-webui.bat_ to start GPT-SoVITS-WebUI. **Users in China can download the package here.** Install the program by running the following commands: [code] ### Linux [code] ### macOS **Note: The models trained with GPUs on Macs result in significantly lower quality compared to those trained on other devices, so we are temporarily using CPUs instead.** Install the program by running the following commands: [code] ### Install Manually #### Install Dependences [code] #### Install FFmpeg ##### Conda Users [code] ##### Ubuntu/Debian Users [code] ##### Windows Users Download and place ffmpeg.exe and ffprobe.exe in the GPT-SoVITS root Install Visual Studio 2017 ##### MacOS Users [code] ### Running GPT-SoVITS with Docker #### Docker Image Selection Due to rapid development in the codebase and a slower Docker image release cycle, please: - Check Docker Hub for the latest available image tags - Choose an a