# Text-to-Speech on Seed ZH-Hard

Source: [Text-to-Speech on Seed ZH-Hard](<https://www.sota2.com/research/sota/text-to-speech-on-seed-zh-hard>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-01T08:04:29.686Z

Evaluation of Text-to-Speech synthesis performance on the Seed ZH-Hard dataset, measured using Character Error Rate (CER) and Similarity (SIM).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Text-to-Speech |
| Dataset (including any stated split) | Seed ZH-Hard |
| Metric | CER |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [CER](<https://www.sota2.com/research/sota/text-to-speech-on-seed-zh-hard.md?metric=CER>): Lower is better; unit: PERCENT.

- [SIM](<https://www.sota2.com/research/sota/text-to-speech-on-seed-zh-hard.md?metric=SIM>): Higher is better; unit: PERCENT.

## Recorded results

| Method | CER | Result date | Report paper |
| --- | --- | --- | --- |
| CosyVoice3.5 | 5.71 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| CosyVoice3-1.5B | 5.83 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| LongCat-AudioDiT-3.5B | 6.04 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| LongCat-AudioDiT-1B | 6.33 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| Qwen3-TTS | 6.76 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| CosyVoice2 | 6.83 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| IndexTTS2 | 7.12 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| Seed-ICL | 7.59 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| FireRedTTS-1S | 7.63 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| Qwen2.5-Omni | 7.97 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| F5 TTS | 8.67 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| F5R-TTS | 8.79 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| VoxCPM | 8.87 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| MaskGCT | 10.27 | Not recorded | 69cca6bf0636e5bf4afcbd4f |
| CosyVoice | 11.75 | Not recorded | 69cca6bf0636e5bf4afcbd4f |

### CosyVoice3.5

CER: 5.71. Result ID: 69ccd17d47f34ce924b65b87.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

Recorded evaluation configuration: {"Model Architecture Type":"AR/Hybrid"}. This record does not assert independent reproduction.

### CosyVoice3-1.5B

CER: 5.83. Result ID: 69ccd17d47f34ce924b65b83.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78dd1e209131cea7ae5b.md>)

Recorded evaluation configuration: {"Model Architecture Type":"AR/Hybrid","Number of Parameters":"1.5B"}. This record does not assert independent reproduction.

### LongCat-AudioDiT-3.5B

CER: 6.04. Result ID: 69ccd17d47f34ce924b65b89.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

Recorded evaluation configuration: {"Number of Parameters":"3.5B"}. This record does not assert independent reproduction.

### LongCat-AudioDiT-1B

CER: 6.33. Result ID: 69ccd17d47f34ce924b65b88.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

Recorded evaluation configuration: {"Number of Parameters":"1B"}. This record does not assert independent reproduction.

### Qwen3-TTS

CER: 6.76. Result ID: 69ccd17d47f34ce924b65b86.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6973006ab2be0ed85a78c8c5.md>)

[Implementation](<https://github.com/QwenLM/Qwen3-TTS>)

Recorded evaluation configuration: {"Model Architecture Type":"AR/Hybrid"}. This record does not assert independent reproduction.

### CosyVoice2

CER: 6.83. Result ID: 69ccd17d47f34ce924b65b81.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76591e209131cea6c851.md>)

Recorded evaluation configuration: {"Model Architecture Type":"AR/Hybrid"}. This record does not assert independent reproduction.

### IndexTTS2

CER: 7.12. Result ID: 69ccd17d47f34ce924b65b84.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b1a1e209131cea86926.md>)

Recorded evaluation configuration: {"Model Architecture Type":"AR/Hybrid"}. This record does not assert independent reproduction.

### Seed-ICL

CER: 7.59. Result ID: 69ccd17d47f34ce924b65b7e.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736f1e209131cea5c769.md>)

Recorded evaluation configuration: {"Model Architecture Type":"AR/Hybrid"}. This record does not assert independent reproduction.

### FireRedTTS-1S

CER: 7.63. Result ID: 69ccd17d47f34ce924b65b82.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78c61e209131cea7a6e0.md>)

Recorded evaluation configuration: {"Model Architecture Type":"AR/Hybrid"}. This record does not assert independent reproduction.

### Qwen2.5-Omni

CER: 7.97. Result ID: 69ccd17d47f34ce924b65b7f.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77a21e209131cea7482c.md>)

Recorded evaluation configuration: {"Model Architecture Type":"AR/Hybrid"}. This record does not assert independent reproduction.

### F5 TTS

CER: 8.67. Result ID: 69ccd17d47f34ce924b65b7c.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a71e209131cea79a4f.md>)

[Implementation](<https://github.com/SWivid/F5-TTS>)

Recorded evaluation configuration: {"Model Architecture Type":"NAR"}. This record does not assert independent reproduction.

### F5R-TTS

CER: 8.79. Result ID: 69ccd17d47f34ce924b65b7d.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78361e209131cea773d1.md>)

Recorded evaluation configuration: {"Model Architecture Type":"NAR"}. This record does not assert independent reproduction.

### VoxCPM

CER: 8.87. Result ID: 69ccd17d47f34ce924b65b85.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb81e209131cea8a230.md>)

Recorded evaluation configuration: {"Model Architecture Type":"AR/Hybrid"}. This record does not assert independent reproduction.

### MaskGCT

CER: 10.27. Result ID: 69ccd17d47f34ce924b65b7b.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75531e209131cea672d9.md>)

Recorded evaluation configuration: {"Model Architecture Type":"NAR"}. This record does not assert independent reproduction.

### CosyVoice

CER: 11.75. Result ID: 69ccd17d47f34ce924b65b80.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6bf0636e5bf4afcbd4f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74031e209131cea5f3e0.md>)

Recorded evaluation configuration: {"Model Architecture Type":"AR/Hybrid"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
