# Speech Translation on NTUML Code-Switching 2021 (test) Source: [Speech Translation on NTUML Code-Switching 2021 (test)]() Collection index: [llms.txt]() Data updated: 2026-05-13T10:34:31.597Z Evaluation of Speech Translation performance on the test split of the NTUML Code-Switching 2021 dataset, measured using BLEU and COMET scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Speech Translation | | Dataset (including any stated split) | NTUML Code-Switching 2021 (test) | | Metric | BLEU | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [BLEU](): Higher is better; unit: SCALAR. - [COMET](): Higher is better; unit: SCALAR. ## Recorded results | Method | BLEU | Result date | Report paper | | --- | --- | --- | --- | | CSST-SSA | 39.52 | Not recorded | 691aac496750be83fe5ce5aa | | CSST-SSA | 39.52 | Not recorded | 691aac496750be83fe5ce5aa | | CSST-SSA | 39.21 | Not recorded | 691aac496750be83fe5ce5aa | | CSST-SSA | 39.05 | Not recorded | 691aac496750be83fe5ce5aa | | CSST-SSA | 38.86 | Not recorded | 691aac496750be83fe5ce5aa | | CSST-SSA | 38.68 | Not recorded | 691aac496750be83fe5ce5aa | | CSST-SSA | 38.14 | Not recorded | 691aac496750be83fe5ce5aa | | SeamlessM4T | 38.03 | Not recorded | 691aac496750be83fe5ce5aa | | CSST-SSA | 37.74 | Not recorded | 691aac496750be83fe5ce5aa | | CSST-SSA | 36.85 | Not recorded | 691aac496750be83fe5ce5aa | | Qwen3-Omni-30B-A3B-Instruct | 35.88 | Not recorded | 691aac496750be83fe5ce5aa | | Whisper+LLaMA | 34.85 | Not recorded | 691aac496750be83fe5ce5aa | | LLaST | 32.53 | Not recorded | 691aac496750be83fe5ce5aa | | Voxtral-Small-24B-2507 | 32.2 | Not recorded | 691aac496750be83fe5ce5aa | | Whisper | 29.12 | Not recorded | 691aac496750be83fe5ce5aa | | Voxtral-Mini-3B-2507 | 28.66 | Not recorded | 691aac496750be83fe5ce5aa | | Qwen2-Audio-7B-Instruct | 23.66 | Not recorded | 691aac496750be83fe5ce5aa | | SALMONN-13B | 16.15 | Not recorded | 691aac496750be83fe5ce5aa | ### CSST-SSA BLEU: 39.52. Result ID: 6a04524447f34ce924ead990. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### CSST-SSA BLEU: 39.52. Result ID: 6a04524447f34ce924ead9a5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### CSST-SSA BLEU: 39.21. Result ID: 6a04524447f34ce924ead9a9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Variant":"w/o Ltransition"}. This record does not assert independent reproduction. ### CSST-SSA BLEU: 39.05. Result ID: 6a04524447f34ce924ead9a7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Variant":"w/o Llang"}. This record does not assert independent reproduction. ### CSST-SSA BLEU: 38.86. Result ID: 6a04524447f34ce924ead9a8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Variant":"w/o Lbalance"}. This record does not assert independent reproduction. ### CSST-SSA BLEU: 38.68. Result ID: 6a04524447f34ce924ead9aa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Variant":"conventional L'balance"}. This record does not assert independent reproduction. ### CSST-SSA BLEU: 38.14. Result ID: 6a04524447f34ce924ead9ab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Variant":"w/o Stage 1"}. This record does not assert independent reproduction. ### SeamlessM4T BLEU: 38.03. Result ID: 6a04524447f34ce924ead9a2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### CSST-SSA BLEU: 37.74. Result ID: 6a04524447f34ce924ead9ac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Variant":"w/o Stage 3"}. This record does not assert independent reproduction. ### CSST-SSA BLEU: 36.85. Result ID: 6a04524447f34ce924ead9a6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Variant":"w/o MoE Speech Projector"}. This record does not assert independent reproduction. ### Qwen3-Omni-30B-A3B-Instruct BLEU: 35.88. Result ID: 6a04524447f34ce924ead98d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### Whisper+LLaMA BLEU: 34.85. Result ID: 6a04524447f34ce924ead9a3. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"cascaded"}. This record does not assert independent reproduction. ### LLaST BLEU: 32.53. Result ID: 6a04524447f34ce924ead9a4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Voxtral-Small-24B-2507 BLEU: 32.2. Result ID: 6a04524447f34ce924ead98f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### Whisper BLEU: 29.12. Result ID: 6a04524447f34ce924ead9a1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Voxtral-Mini-3B-2507 BLEU: 28.66. Result ID: 6a04524447f34ce924ead98e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### Qwen2-Audio-7B-Instruct BLEU: 23.66. Result ID: 6a04524447f34ce924ead98c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. ### SALMONN-13B BLEU: 16.15. Result ID: 6a04524447f34ce924ead98b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.