Speech-to-Text Translation on Tatoeba 4392 utterances
30.7SacreBLEU (Fr)none (MT)
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| none (MT)ASR Model=none (MT), Size=-, RTFx=-2025.09 | 30.7 | 0.73 | 20.9 | 0.67 | 35.1 | 0.79 | 22.9 | 0.77 | 32.9 | 0.78 | 28.5 | 0.75 | |
| Whisper medium.enASR Model=medium.en, Size=769M, RTFx=13.42025.09 | 29.5 | 0.72 | 20.2 | 0.66 | 33.1 | 0.78 | 20.7 | 0.76 | 30.9 | 0.77 | 26.9 | 0.74 | |
| Whisper small.enASR Model=small.en, Size=244M, RTFx=24.82025.09 | 29.1 | 0.72 | 20.1 | 0.66 | 32.9 | 0.78 | 20.8 | 0.75 | 31 | 0.76 | 26.8 | 0.74 | |
| Whisper large-v2ASR Model=large-v2, Size=1.55B, RTFx=8.72025.09 | 29.1 | 0.72 | 19.8 | 0.66 | 32.7 | 0.78 | 20.8 | 0.76 | 30.8 | 0.77 | 26.7 | 0.74 | |
| Wav2Vec2 large-960hASR Model=large-960h, Size=317M, RTFx=158.92025.09 | 28.3 | 0.72 | 19.6 | 0.66 | 31.7 | 0.77 | 20.4 | 0.75 | 30.1 | 0.76 | 26 | 0.73 | |
| Wav2Vec2 base-960hASR Model=base-960h, Size=95M, RTFx=196.02025.09 | 27.6 | 0.71 | 19.4 | 0.65 | 30.5 | 0.76 | 20.3 | 0.74 | 29.1 | 0.75 | 25.4 | 0.72 |