Complex Instruction Following on InstructTTSEval-ZH
90.9APSGround-truth
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Ground-truthSource Type=Baseline2026.01 | 90.9 | 86.7 | 69.8 | 82.5 | |
| Gemini-proSource Type=Closed-sourced2026.01 | 89 | 90.1 | 75.5 | 84.8 | |
| Gemini-TTS-ProVoice Control Type=fixed voice editing2026.03 | 89 | 90.1 | 75.5 | — | |
| Gemini-TTS-Pro2026.06 | 89 | 90.1 | 75.5 | — | |
| Gemini-flashSource Type=Closed-sourced2026.01 | 88.2 | 90.9 | 77.3 | 85.4 | |
| Qwen3-TTS-12Hz-1.7B-VDFrequency=12Hz, Parameters=1.7B2026.06 | 85.2 | 81.1 | 65.1 | — | |
| VoxCPM22026.06 | 85.2 | 71.5 | 60.8 | — | |
| Qwen3-TTS-VD2026.03 | 84.3 | 82.9 | 77.4 | — | |
| MOSS-VoiceGenerator2026.03 | 78 | 80 | 74 | — | |
| MOSS-VoiceGenerator2026.06 | 78 | 80 | 74 | — | |
| MiMo-Audio-7B-InstructSource Type=Open-sourced2026.01 | 75.7 | 74.3 | 61.5 | 70.5 | |
| VoiceSculptor-VD2026.03 | 75.7 | 64.7 | 61.5 | — | |
| MIMO-Audio-7B-Instruct2026.03 | 75.7 | 74.3 | 61.5 | — | |
| VoiceSculptor2026.06 | 75.7 | 64.7 | 61.5 | — | |
| Mimo-Audio-7B-InstructParameters=7B2026.06 | 75.7 | 74.3 | 61.5 | — | |
| FlexiVoiceSource Type=Open-sourced2026.01 | 71 | 71.8 | 69.7 | 70.8 | |
| FlexiVoice-BaseSource Type=Open-sourced2026.01 | 56.7 | 59.1 | 59.5 | 58.4 | |
| GPT-4o-mini-TTSSource Type=Closed-sourced2026.01 | 54.9 | 52.3 | 46 | 51.1 | |
| GPT-4o-mini-TTSVoice Control Type=fixed voice editing2026.03 | 54.9 | 52.3 | 46 | — | |
| GPT-4o-mini-TTS2026.06 | 54.9 | 52.3 | 46 | — | |
| VoxInstructSource Type=Open-sourced2026.01 | 47.5 | 52.3 | 42.6 | 47.5 | |
| VoxInstructRequires reference audio=true2026.03 | 47.5 | 52.3 | 42.6 | — | |
| VoxInstruct2026.06 | 47.5 | 52.3 | 42.6 | — |