Emotion and speaker adaptation on Chinese speech data (test)
85.7SS (%)CSP-FT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CSP-FTFine-tuning strategy=Characteristic-Specific Partial Fine-Tuning (Proposed), Base model architecture=Fun-CosyVoice3.02025.01 | 85.7 | 94.1 | 1.2 | |
| Full FTFine-tuning strategy=Full Fine-tuning, Base model architecture=Fun-CosyVoice3.02025.01 | 85.1 | 93.9 | 3.9 | |
| LoRA FTFine-tuning strategy=LoRA, Base model architecture=Fun-CosyVoice3.02025.01 | 84.7 | 92.8 | 2.1 | |
| OriginFine-tuning strategy=Zero-shot (None), Base model architecture=Fun-CosyVoice3.02025.01 | 83.5 | 90.5 | 1.2 | |
| CSP-FTFine-tuning strategy=Characteristic-Specific Partial Fine-Tuning (Proposed), Base model architecture=CosyVoice2025.01 | 81.2 | 91.9 | 2.5 | |
| Full FTFine-tuning strategy=Full Fine-tuning, Base model architecture=CosyVoice2025.01 | 81 | 91.2 | 3 | |
| LoRA FTFine-tuning strategy=LoRA, Base model architecture=CosyVoice2025.01 | 80.2 | 89.9 | 2.7 | |
| OriginFine-tuning strategy=Zero-shot (None), Base model architecture=CosyVoice2025.01 | 79.8 | 88.6 | 2.5 | |
| CSP-FTFine-tuning strategy=Characteristic-Specific Partial Fine-Tuning (Proposed), Base model architecture=VALLE-X2025.01 | 78 | 87 | 6 | |
| Full FTFine-tuning strategy=Full Fine-tuning, Base model architecture=VALLE-X2025.01 | 77.7 | 86.1 | 7.6 | |
| LoRA FTFine-tuning strategy=LoRA, Base model architecture=VALLE-X2025.01 | 76.9 | 84.2 | 7.4 | |
| OriginFine-tuning strategy=Zero-shot (None), Base model architecture=VALLE-X2025.01 | 75.4 | 82.3 | 5.2 | |
| Full FTFine-tuning strategy=Full Fine-tuning, Base model architecture=GPT-SoVITS2025.01 | 75.4 | 80.9 | 3.3 | |
| CSP-FTFine-tuning strategy=Characteristic-Specific Partial Fine-Tuning (Proposed), Base model architecture=GPT-SoVITS2025.01 | 75.2 | 81 | 2.5 | |
| LoRA FTFine-tuning strategy=LoRA, Base model architecture=GPT-SoVITS2025.01 | 74.8 | 78.5 | 3.4 | |
| OriginFine-tuning strategy=Zero-shot (None), Base model architecture=GPT-SoVITS2025.01 | 73.8 | 70.3 | 2.2 |