# Speech Translation on NTUML Monolingual 2021 (test) Source: [Speech Translation on NTUML Monolingual 2021 (test)]() Collection index: [llms.txt]() Data updated: 2026-05-13T10:34:31.628Z Evaluation of Speech Translation performance on the test split of the NTUML Monolingual 2021 dataset, measured using metrics such as BLEU and COMET. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Speech Translation | | Dataset (including any stated split) | NTUML Monolingual 2021 (test) | | Metric | BLEU | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 11 of 11 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [BLEU](): Higher is better; unit: PERCENT. - [COMET](): Higher is better; unit: PERCENT. ## Recorded results | Method | BLEU | Result date | Report paper | | --- | --- | --- | --- | | CSST-SSA | 36.27 | Not recorded | 691aac496750be83fe5ce5aa | | CSST-SSA | 36.27 | Not recorded | 691aac496750be83fe5ce5aa | | SeamlessM4T | 35.78 | Not recorded | 691aac496750be83fe5ce5aa | | Whisper+LLaMA | 35.21 | Not recorded | 691aac496750be83fe5ce5aa | | LLaST | 33.81 | Not recorded | 691aac496750be83fe5ce5aa | | Qwen3-Omni-30B-A3B-Instruct | 33.63 | Not recorded | 691aac496750be83fe5ce5aa | | Whisper | 28.92 | Not recorded | 691aac496750be83fe5ce5aa | | Voxtral-Small-24B-2507 | 27.71 | Not recorded | 691aac496750be83fe5ce5aa | | Qwen2-Audio-7B-Instruct | 27.22 | Not recorded | 691aac496750be83fe5ce5aa | | Voxtral-Mini-3B-2507 | 26.05 | Not recorded | 691aac496750be83fe5ce5aa | | SALMONN-13B | 14.85 | Not recorded | 691aac496750be83fe5ce5aa | ### CSST-SSA BLEU: 36.27. Result ID: 6a04524447f34ce924ead996. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### CSST-SSA BLEU: 36.27. Result ID: 6a04524447f34ce924ead9b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### SeamlessM4T BLEU: 35.78. Result ID: 6a04524447f34ce924ead9ae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Whisper+LLaMA BLEU: 35.21. Result ID: 6a04524447f34ce924ead9af. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"cascaded"}. This record does not assert independent reproduction. ### LLaST BLEU: 33.81. Result ID: 6a04524447f34ce924ead9b0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Qwen3-Omni-30B-A3B-Instruct BLEU: 33.63. Result ID: 6a04524447f34ce924ead993. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### Whisper BLEU: 28.92. Result ID: 6a04524447f34ce924ead9ad. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Voxtral-Small-24B-2507 BLEU: 27.71. Result ID: 6a04524447f34ce924ead995. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### Qwen2-Audio-7B-Instruct BLEU: 27.22. Result ID: 6a04524447f34ce924ead992. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### Voxtral-Mini-3B-2507 BLEU: 26.05. Result ID: 6a04524447f34ce924ead994. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### SALMONN-13B BLEU: 14.85. Result ID: 6a04524447f34ce924ead991. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.