# Speech Translation on Fisher Monolingual (test) Source: [Speech Translation on Fisher Monolingual (test)]() Collection index: [llms.txt]() Data updated: 2026-05-13T10:34:31.566Z Evaluation of Speech Translation performance on the test split of the Fisher Monolingual dataset, measured using BLEU and COMET scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Speech Translation | | Dataset (including any stated split) | Fisher Monolingual (test) | | Metric | BLEU | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 11 of 11 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [BLEU](): Higher is better; unit: SCALAR. - [COMET](): Higher is better; unit: SCALAR. ## Recorded results | Method | BLEU | Result date | Report paper | | --- | --- | --- | --- | | CSST-SSA | 35.87 | Not recorded | 691aac496750be83fe5ce5aa | | CSST-SSA | 35.87 | Not recorded | 691aac496750be83fe5ce5aa | | SeamlessM4T | 35.04 | Not recorded | 691aac496750be83fe5ce5aa | | Qwen3-Omni-30B-A3B-Instruct | 34.81 | Not recorded | 691aac496750be83fe5ce5aa | | Voxtral-Small-24B-2507 | 34.65 | Not recorded | 691aac496750be83fe5ce5aa | | Whisper+LLaMA | 33.2 | Not recorded | 691aac496750be83fe5ce5aa | | Voxtral-Mini-3B-2507 | 32.71 | Not recorded | 691aac496750be83fe5ce5aa | | Whisper | 31.04 | Not recorded | 691aac496750be83fe5ce5aa | | LLaST | 30.67 | Not recorded | 691aac496750be83fe5ce5aa | | Qwen2-Audio-7B-Instruct | 21.49 | Not recorded | 691aac496750be83fe5ce5aa | | SALMONN-13B | 16.57 | Not recorded | 691aac496750be83fe5ce5aa | ### CSST-SSA BLEU: 35.87. Result ID: 6a04524447f34ce924ead98a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### CSST-SSA BLEU: 35.87. Result ID: 6a04524447f34ce924ead9a0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### SeamlessM4T BLEU: 35.04. Result ID: 6a04524447f34ce924ead99d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Qwen3-Omni-30B-A3B-Instruct BLEU: 34.81. Result ID: 6a04524447f34ce924ead987. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### Voxtral-Small-24B-2507 BLEU: 34.65. Result ID: 6a04524447f34ce924ead989. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### Whisper+LLaMA BLEU: 33.2. Result ID: 6a04524447f34ce924ead99e. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"cascaded"}. This record does not assert independent reproduction. ### Voxtral-Mini-3B-2507 BLEU: 32.71. Result ID: 6a04524447f34ce924ead988. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### Whisper BLEU: 31.04. Result ID: 6a04524447f34ce924ead99c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLaST BLEU: 30.67. Result ID: 6a04524447f34ce924ead99f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Qwen2-Audio-7B-Instruct BLEU: 21.49. Result ID: 6a04524447f34ce924ead986. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### SALMONN-13B BLEU: 16.57. Result ID: 6a04524447f34ce924ead985. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.