# Zero-shot Voice Cloning on Seed-TTS-Eval zh (test) Source: [Zero-shot Voice Cloning on Seed-TTS-Eval zh (test)]() Collection index: [llms.txt]() Data updated: 2026-06-08T07:26:58.063Z Evaluation of Zero-shot Voice Cloning performance on the test split of the Seed-TTS-Eval Chinese dataset, measured using Word Error Rate (WER) and Similarity (SIM). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Zero-shot Voice Cloning | | Dataset (including any stated split) | Seed-TTS-Eval zh (test) | | Metric | WER | | Unit | PERCENT | | Direction | Lower is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [WER](): Lower is better; unit: PERCENT. - [Similarity (SIM)](): Higher is better; unit: PERCENT. ## Recorded results | Method | WER | Result date | Report paper | | --- | --- | --- | --- | | MiniMax-Speech | 0.83 | Not recorded | 6a264c6390966ade919be869 | | dots.tts (SOAR) | 0.94 | Not recorded | 6a264c6390966ade919be869 | | dots.tts (MF, NFE=4) | 0.94 | Not recorded | 6a264c6390966ade919be869 | | dots.tts (Pretrain) | 0.96 | Not recorded | 6a264c6390966ade919be869 | | VoxCPM 2 | 0.97 | Not recorded | 6a264c6390966ade919be869 | | DiTAR | 1.02 | Not recorded | 6a264c6390966ade919be869 | | dots.tts (MF, NFE=3) | 1.02 | Not recorded | 6a264c6390966ade919be869 | | IndexTTS 2 | 1.03 | Not recorded | 6a264c6390966ade919be869 | | dots.tts (MF, NFE=2) | 1.04 | Not recorded | 6a264c6390966ade919be869 | | CosyVoice 3 | 1.12 | Not recorded | 6a264c6390966ade919be869 | | Seed-TTS | 1.12 | Not recorded | 6a264c6390966ade919be869 | | FireRedTTS 2 | 1.14 | Not recorded | 6a264c6390966ade919be869 | | VibeVoice | 1.16 | Not recorded | 6a264c6390966ade919be869 | | Qwen3-TTS | 1.22 | Not recorded | 6a264c6390966ade919be869 | | MegaTTS 3 | 1.52 | Not recorded | 6a264c6390966ade919be869 | | F5-TTS | 1.53 | Not recorded | 6a264c6390966ade919be869 | ### MiniMax-Speech WER: 0.83. Result ID: 6a266ebdfbc373592c22ceee. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### dots.tts (SOAR) WER: 0.94. Result ID: 6a266ebdfbc373592c22cef5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Params":"2B","Variant":"SOAR"}. This record does not assert independent reproduction. ### dots.tts (MF, NFE=4) WER: 0.94. Result ID: 6a266ebdfbc373592c22cef6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Params":"2B","Distillation Method":"MeanFlow","NFE":"4"}. This record does not assert independent reproduction. ### dots.tts (Pretrain) WER: 0.96. Result ID: 6a266ebdfbc373592c22cef4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Params":"2B","Variant":"Pretrain"}. This record does not assert independent reproduction. ### VoxCPM 2 WER: 0.97. Result ID: 6a266ebdfbc373592c22cef3. [Reporting paper]() Recorded evaluation configuration: {"Params":"2B"}. This record does not assert independent reproduction. ### DiTAR WER: 1.02. Result ID: 6a266ebdfbc373592c22cef1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Params":"0.6B"}. This record does not assert independent reproduction. ### dots.tts (MF, NFE=3) WER: 1.02. Result ID: 6a266ebdfbc373592c22cef7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Params":"2B","Distillation Method":"MeanFlow","NFE":"3"}. This record does not assert independent reproduction. ### IndexTTS 2 WER: 1.03. Result ID: 6a266ebdfbc373592c22ceec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Params":"1.5B"}. This record does not assert independent reproduction. ### dots.tts (MF, NFE=2) WER: 1.04. Result ID: 6a266ebdfbc373592c22cef8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Params":"2B","Distillation Method":"MeanFlow","NFE":"2"}. This record does not assert independent reproduction. ### CosyVoice 3 WER: 1.12. Result ID: 6a266ebdfbc373592c22cee9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Params":"1.5B"}. This record does not assert independent reproduction. ### Seed-TTS WER: 1.12. Result ID: 6a266ebdfbc373592c22cef0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### FireRedTTS 2 WER: 1.14. Result ID: 6a266ebdfbc373592c22ceeb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Params":"1.5B"}. This record does not assert independent reproduction. ### VibeVoice WER: 1.16. Result ID: 6a266ebdfbc373592c22cef2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Params":"1.5B"}. This record does not assert independent reproduction. ### Qwen3-TTS WER: 1.22. Result ID: 6a266ebdfbc373592c22ceef. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Params":"1.7B"}. This record does not assert independent reproduction. ### MegaTTS 3 WER: 1.52. Result ID: 6a266ebdfbc373592c22ceed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Params":"0.5B"}. This record does not assert independent reproduction. ### F5-TTS WER: 1.53. Result ID: 6a266ebdfbc373592c22ceea. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Params":"0.3B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.