Speech-to-Speech Translation on CVSS (test)
84.52ASR-BLEU (Fr->En)Ground Truth
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Ground Truth2024.06 | 84.52 | 75.53 | 88.54 | 82.86 | — | |
| ComSpeechS2ST Training Data=true, S2TT Training Data=true, TTS Training Data=true, Pre-training=true, Scenario=Supervised Learning2024.06 | 28.15 | 18.16 | 24.8 | 23.7 | 3.4 | |
| ComSpeechS2ST Training Data=true, S2TT Training Data=true, TTS Training Data=false, Pre-training=false, Scenario=Supervised Learning2024.06 | 27.58 | 17.35 | 24.29 | 23.07 | 3.4 | |
| ComSpeech-ZSS2ST Training Data=false, S2TT Training Data=true, TTS Training Data=true, Scenario=Zero-shot Learning2024.06 | 27.55 | 17.67 | 23.8 | 23.01 | 3.4 | |
| S2TT + G2P + TTSS2ST Training Data=false, S2TT Training Data=true, TTS Training Data=true, Scenario=Zero-shot Learning2024.06 | 27.04 | 16.97 | 23.26 | 22.42 | 3.49 | |
| UnitYS2ST Training Data=true, S2TT Training Data=true, TTS Training Data=false, Scenario=Supervised Learning2024.06 | 26.9 | 16.36 | 24.06 | 22.44 | 0.98 | |
| Translatotron 2S2ST Training Data=true, S2TT Training Data=true, TTS Training Data=false, Scenario=Supervised Learning2024.06 | 26.12 | 16.92 | 22.98 | 22.01 | 1 | |
| DASpeechS2ST Training Data=true, S2TT Training Data=false, TTS Training Data=false, Scenario=Supervised Learning2024.06 | 25.03 | — | — | — | 10.05 | |
| S2UTS2ST Training Data=true, S2TT Training Data=true, TTS Training Data=false, Scenario=Supervised Learning2024.06 | 22.23 | 2.99 | 18.53 | 14.58 | 0.62 |