Speech Translation on EuroParl en-es (test)
85.9COMETTranscripts + EuroLLM 9B
Evaluation results
| Method | Links | |
|---|---|---|
| Transcripts + EuroLLM 9BEvaluation Setting=topline, Backbone=EuroLLM 9B2026.01 | 85.9 | |
| SpeechMapperBackbone=EuroLLM, Stage=2, Adaptation Objective=ST CE, Evaluation Setting=in-domain2026.01 | 85.4 | |
| SpeechMapperBackbone=Llama 3.1, Stage=2, Adaptation Objective=ST CE, Evaluation Setting=in-domain2026.01 | 84.5 | |
| BEST-IWSLT25-IFEvaluation Setting=in-domain2026.01 | 83.5 | |
| Transcripts + Llama 3.1 8BEvaluation Setting=topline, Backbone=Llama 3.1 8B2026.01 | 82.8 | |
| Seamless STEvaluation Setting=in-domain2026.01 | 80.4 | |
| SpeechMapperBackbone=EuroLLM, Stage=2, Adaptation Objective=ASR CE+MSE, Evaluation Setting=zero-shot2026.01 | 79.9 | |
| SpeechMapperBackbone=EuroLLM, Stage=2, Adaptation Objective=ASR CE, Evaluation Setting=zero-shot2026.01 | 78.6 | |
| SpeechMapperBackbone=Llama 3.1, Stage=1, Evaluation Setting=zero-shot2026.01 | 76.4 | |
| SpeechMapperBackbone=Llama 3.1, Stage=2, Adaptation Objective=ASR CE+MSE, Evaluation Setting=zero-shot2026.01 | 74.7 | |
| SpeechMapperBackbone=EuroLLM, Stage=1, Evaluation Setting=zero-shot2026.01 | 73.5 | |
| SpeechMapperBackbone=Llama 3.1, Stage=2, Adaptation Objective=ASR CE, Evaluation Setting=zero-shot2026.01 | 70.4 |