Text-to-Speech on English emotional dataset
94.8SS ScoreCSP-FT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CSP-FTBackbone=Fun-CosyVoice3.0, Param.=29.8/506.22025.01 | 94.8 | 96.8 | 3.8 | |
| Highest Two FTBackbone=Fun-CosyVoice3.0, Param.=29.8/506.22025.01 | 94.6 | 96.5 | 6.5 | |
| Full FTBackbone=Fun-CosyVoice3.0, Param.=506.2/506.22025.01 | 94.5 | 97 | 12.1 | |
| Second Half FTBackbone=Fun-CosyVoice3.0, Param.=178.9/506.22025.01 | 93.7 | 96.6 | 7.5 | |
| Shallowest TwoBackbone=Fun-CosyVoice3.0, Param.=29.8/506.22025.01 | 93.6 | 95.5 | 6.8 | |
| Lowest Two FTBackbone=Fun-CosyVoice3.0, Param.=29.8/506.22025.01 | 93.6 | 95.8 | 4.2 | |
| First Half FTBackbone=Fun-CosyVoice3.0, Param.=178.9/506.22025.01 | 93.5 | 95.2 | 11.5 | |
| Deepest TwoBackbone=Fun-CosyVoice3.0, Param.=29.8/506.22025.01 | 93.5 | 95 | 7.2 | |
| LoRA FTBackbone=Fun-CosyVoice3.0, Param.=43.5/549.72025.01 | 93.3 | 94.3 | 8.9 | |
| LoRA FTBackbone=Fun-CosyVoice3.0, Param.=29.0/535.22025.01 | 93.1 | 94 | 8.5 | |
| LoRA FTBackbone=Fun-CosyVoice3.0, Param.=14.5/520.72025.01 | 93 | 94.1 | 9.2 | |
| CSP-FTBackbone=CosyVoice, Param.=27.3/310.72025.01 | 92.6 | 95.5 | 9.2 | |
| Full FTBackbone=CosyVoice, Param.=310.7/310.72025.01 | 92.5 | 95.6 | 25.1 | |
| Highest Two FTBackbone=CosyVoice, Param.=27.3/310.72025.01 | 92.5 | 95.3 | 14.6 | |
| Second Half FTBackbone=CosyVoice, Param.=95.5/310.72025.01 | 92.4 | 95.6 | 15.7 | |
| First Half FTBackbone=CosyVoice, Param.=95.5/310.72025.01 | 92.3 | 94.2 | 22.6 | |
| Shallowest TwoBackbone=CosyVoice, Param.=27.3/310.72025.01 | 92.3 | 94.7 | 14.7 | |
| Deepest TwoBackbone=CosyVoice, Param.=27.3/310.72025.01 | 92.3 | 94 | 15.7 | |
| Lowest Two FTBackbone=CosyVoice, Param.=27.3/310.72025.01 | 92.3 | 94.8 | 12.3 | |
| LoRA FTBackbone=CosyVoice, Param.=27.5/338.32025.01 | 92 | 93.1 | 18.1 | |
| LoRA FTBackbone=CosyVoice, Param.=41.3/352.02025.01 | 91.9 | 93.6 | 19.3 | |
| LoRA FTBackbone=CosyVoice, Param.=13.8/324.52025.01 | 91.8 | 93.3 | 20.6 | |
| OriginBackbone=Fun-CosyVoice3.0, Param.=0/506.22025.01 | 91.2 | 92 | 4 | |
| Full FTBackbone=VALLE-X, Param.=362.1/362.12025.01 | 90.2 | 93 | 9.5 | |
| CSP-FTBackbone=VALLE-X, Param.=25.2/362.12025.01 | 90.2 | 94.2 | 7 | |
| Lowest Two FTBackbone=VALLE-X, Param.=25.2/362.12025.01 | 89.7 | 93 | 8 | |
| Highest Two FTBackbone=VALLE-X, Param.=25.2/362.12025.01 | 89.7 | 93.1 | 10 | |
| First Half FTBackbone=VALLE-X, Param.=151.2/362.12025.01 | 89.6 | 92.9 | 8.4 | |
| LoRA FTBackbone=VALLE-X, Param.=25.1/387.22025.01 | 89.5 | 91.9 | 9.9 | |
| LoRA FTBackbone=VALLE-X, Param.=37.5/399.62025.01 | 89.5 | 92.2 | 9.6 | |
| Second Half FTBackbone=VALLE-X, Param.=151.2/362.12025.01 | 89.4 | 92.3 | 9.8 | |
| Deepest TwoBackbone=VALLE-X, Param.=25.2/362.12025.01 | 89.4 | 92.5 | 9.8 | |
| LoRA FTBackbone=VALLE-X, Param.=12.7/374.82025.01 | 89.2 | 91.7 | 9.5 | |
| Shallowest TwoBackbone=VALLE-X, Param.=25.2/362.12025.01 | 89 | 92.1 | 8.4 | |
| OriginBackbone=CosyVoice, Param.=0/310.72025.01 | 88.9 | 89.8 | 8.4 | |
| OriginBackbone=VALLE-X, Param.=0/362.12025.01 | 84.2 | 85.6 | 8.4 | |
| CSP-FTBackbone=GPT-SoVITS, Param.=6.3/77.52025.01 | 69.9 | 83.2 | 8.5 | |
| Full FTBackbone=GPT-SoVITS, Param.=77.5/77.52025.01 | 69.4 | 83.9 | 10.3 | |
| First Half FTBackbone=GPT-SoVITS, Param.=37.8/77.52025.01 | 69.4 | 83.2 | 13.7 | |
| Second Half FTBackbone=GPT-SoVITS, Param.=37.8/77.52025.01 | 69.4 | 82.8 | 14.5 | |
| Highest Two FTBackbone=GPT-SoVITS, Param.=6.3/77.52025.01 | 69.1 | 83 | 12.4 | |
| Shallowest TwoBackbone=GPT-SoVITS, Param.=6.3/77.52025.01 | 68.9 | 82.5 | 10.4 | |
| LoRA FTBackbone=GPT-SoVITS, Param.=3.1/80.62025.01 | 68.7 | 82.4 | 14.7 | |
| LoRA FTBackbone=GPT-SoVITS, Param.=6.2/83.72025.01 | 68.7 | 82.2 | 12.1 | |
| LoRA FTBackbone=GPT-SoVITS, Param.=9.3/86.82025.01 | 68.7 | 82.4 | 11.8 | |
| Deepest TwoBackbone=GPT-SoVITS, Param.=6.3/77.52025.01 | 68.5 | 82.4 | 13.7 | |
| Lowest Two FTBackbone=GPT-SoVITS, Param.=6.3/77.52025.01 | 68.3 | 82.2 | 9.5 | |
| OriginBackbone=GPT-SoVITS, Param.=0/77.52025.01 | 64 | 77.7 | 8 |