# Speech Translation on MCIF short-form Source: [Speech Translation on MCIF short-form]() Collection index: [llms.txt]() Data updated: 2026-07-08T06:55:18.879Z Evaluation of Speech Translation performance on the MCIF short-form dataset, measured using ST COMET. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Speech Translation | | Dataset (including any stated split) | MCIF short-form | | Metric | ST COMET | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ST COMET](): Higher is better; unit: PERCENT. - [ST COMET (DE)](): Higher is better; unit: PERCENT. - [ST COMET (IT)](): Higher is better; unit: PERCENT. - [ST COMET (ZH)](): Higher is better; unit: PERCENT. ## Recorded results | Method | ST COMET | Result date | Report paper | | --- | --- | --- | --- | | Primary | 78.69 | Not recorded | 6a3e07c4206542251d7cb6d3 | | Primary | 75.5 | Not recorded | 6a3e07c4206542251d7cb6d3 | | Contrastive | 75.16 | Not recorded | 6a3e07c4206542251d7cb6d3 | | Primary | 74.96 | Not recorded | 6a3e07c4206542251d7cb6d3 | | Contrastive | 74.25 | Not recorded | 6a3e07c4206542251d7cb6d3 | | Contrastive | 73.26 | Not recorded | 6a3e07c4206542251d7cb6d3 | | Primary | 72.86 | Not recorded | 6a3e07c4206542251d7cb6d3 | | Contrastive | 70.36 | Not recorded | 6a3e07c4206542251d7cb6d3 | ### Primary ST COMET: 78.69. Result ID: 6a3e1deafbc373592c5e979a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Submission Mode":"Short-form","Language":"en-zh"}. This record does not assert independent reproduction. ### Primary ST COMET: 75.5. Result ID: 6a3e1deafbc373592c5e979b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Submission Mode":"Short-form","Language":"score"}. This record does not assert independent reproduction. ### Contrastive ST COMET: 75.16. Result ID: 6a3e1deafbc373592c5e979d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Submission Mode":"Long-form","Language":"en-it"}. This record does not assert independent reproduction. ### Primary ST COMET: 74.96. Result ID: 6a3e1deafbc373592c5e9799. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Submission Mode":"Short-form","Language":"en-it"}. This record does not assert independent reproduction. ### Contrastive ST COMET: 74.25. Result ID: 6a3e1deafbc373592c5e979e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Submission Mode":"Long-form","Language":"en-zh"}. This record does not assert independent reproduction. ### Contrastive ST COMET: 73.26. Result ID: 6a3e1deafbc373592c5e979f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Submission Mode":"Long-form","Language":"score"}. This record does not assert independent reproduction. ### Primary ST COMET: 72.86. Result ID: 6a3e1deafbc373592c5e9798. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Submission Mode":"Short-form","Language":"en-de"}. This record does not assert independent reproduction. ### Contrastive ST COMET: 70.36. Result ID: 6a3e1deafbc373592c5e979c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Submission Mode":"Long-form","Language":"en-de"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.