fishaudio / fish-speech

Fish Speech 
**English** | 简体中文 | Portuguese | 日本語 | 한국어 | العربية | Español 
> [!IMPORTANT]
> **License Notice** 
> This codebase and its associated model weights are released under **FISH AUDIO COMMUNITY LICENSE**. The S2-Pro weights remain under the Fish Audio Research License. Please refer to LICENSE for more details. We will take action against any violation of the license.
> [!WARNING]
> **Legal Disclaimer** 
> We do not hold any responsibility for any illegal usage of the codebase. Please refer to your local laws about DMCA and other related laws.
## Quick Start
### For Human
- Installation: environment setup, download weights, Docker deployment
- Inference: command line, API server, WebUI
> [!IMPORTANT]
> **We strongly recommend SGLang-Omni for users who care about efficiency; see the SGLang-Omni README.**
>
> **For vLLM Omni server, please read vLLM-Omni Fish Speech S2 Pro Recipe and the User Guide.**
### For LLM Agent
 [code] 
## Models
| Model | Size | Weights | Description |
|------|------|-------------|-------------|
| **Drama 3** | 35B-A3B (3B active per token) | HuggingFace | New-generation flagship for multi-character scenes and long content, with multi-turn revision and local editing |
| S2-Pro | 4B parameters | HuggingFace | Previous-generation flagship with faster inference |
The model type is detected from the checkpoint's `config.json`, and both share the same command line and API server.
---
## Fish Audio Drama 3
**The new-generation voice model, upgraded across the board over S2-Pro.**
Like the S2 series, Drama 3 supports multi-speaker generation, voice cloning and natural-language control, but it makes clear advances in long-form audio, interaction and editability.
### Key features
- **Multi-turn director revision**: guide the previous take directly ("gentler, and a bit sadder"), and the model regenerates it with that context instead of starting over.
- **Infilling and precise editing**: edit audio the way you edit text — replace a single word ("Wednesday" → "Thursday") while the surrounding timbre and transitions stay natural.
- **Scene-style multi-character production**: voice a complete scene with several characters straight from a script description, with streaming support for long text.
- **Long dialogues and long speech**: built for long recordings and extended sessions, keeping characters and timbre stable throughout.
- **Stronger expressiveness**: laughter, crying, whispers and dramatic emotion are no longer flattened by the reference, so the delivery is much closer to a real performance.
- **Multilingual voice cloning**: sets a new level of SOTA for cross-lingual cloning error rates (CER / WER).
- **Natural-language tag control**: inline tags such as `[whisper]`, `[angry]` and `[laughing]` control emotion and prosody.
### What changed compared with S2-Pro
| Capability | S2-Pro | Drama 3 |
| --- | --- | --- |
| Multi-speaker | Supported | Supported, as scene-style multi-character production |
| Voice cloning | Supp