# Machine Translation on WMT19 English-German (En-De) (test) Source: [Machine Translation on WMT19 English-German (En-De) (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:37:04.383Z Evaluation of Machine Translation performance on the WMT 2019 English-German test set, reporting metrics including BLEU, TER, METEOR, and BERTScore. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Machine Translation | | Dataset (including any stated split) | WMT19 English-German (En-De) (test) | | Metric | BLEU | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 19 of 19 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [BLEU](): Higher is better; unit: PERCENT. - [TER](): Lower is better; unit: PERCENT. - [METEOR](): Higher is better; unit: PERCENT. - [BERTScore](): Higher is better; unit: PERCENT. - [DA-BERTScore](): Higher is better; unit: PERCENT. - [Human Evaluation Score](): Higher is better; unit: PERCENT. - [HUP Score](): Higher is better; unit: SCALAR. - [Average Score](): Higher is better; unit: PERCENT. - [Delta](): Higher is better; unit: SCALAR. ## Recorded results | Method | BLEU | Result date | Report paper | | --- | --- | --- | --- | | MSRA.6926 | 46.03 | Not recorded | 68fa6a711e209131cea2820c | | Microsoft.dl.6808 | 44.83 | Not recorded | 68fa6a711e209131cea2820c | | Microsoft.sd.6974 | 44.77 | Not recorded | 68fa6a711e209131cea2820c | | NEU.6763 | 44.6 | Not recorded | 68fa6a711e209131cea2820c | | UCAM.6731 | 44.13 | Not recorded | 68fa6a711e209131cea2820c | | Facebook.6862 | 43.64 | Not recorded | 68fa6a711e209131cea2820c | | General + In-Domain Pre-training | 42.2 | Not recorded | 68fa6bfc1e209131cea316d3 | | General + In-Domain Pre-training + Input Adaptation | 41.3 | Not recorded | 68fa6bfc1e209131cea316d3 | | General | 40.8 | Not recorded | 68fa6bfc1e209131cea316d3 | | General + Input Adaptation | 40.8 | Not recorded | 68fa6bfc1e209131cea316d3 | | Baseline | 39.4 | Not recorded | 68fa6bfc1e209131cea316d3 | | +Online ST | 28.5 | Not recorded | 68fa6c0e1e209131cea31c0b | | +CBD | 28.3 | Not recorded | 68fa6c0e1e209131cea31c0b | | +Online ST | 28.3 | Not recorded | 68fa6c0e1e209131cea31c0b | | +CBD | 28.3 | Not recorded | 68fa6c0e1e209131cea31c0b | | +Offline ST | 27.2 | Not recorded | 68fa6c0e1e209131cea31c0b | | +Offline ST | 26.9 | Not recorded | 68fa6c0e1e209131cea31c0b | | UNMT | 26.7 | Not recorded | 68fa6c0e1e209131cea31c0b | | UNMT | 26.6 | Not recorded | 68fa6c0e1e209131cea31c0b | ### MSRA.6926 BLEU: 46.03. Result ID: 698e3487ffc3901de09ba75a. [Reporting paper]() Recorded evaluation configuration: {"System":"MSRA.6926"}. This record does not assert independent reproduction. ### Microsoft.dl.6808 BLEU: 44.83. Result ID: 698e3487ffc3901de09ba759. [Reporting paper]() Recorded evaluation configuration: {"System":"Microsoft.dl.6808"}. This record does not assert independent reproduction. ### Microsoft.sd.6974 BLEU: 44.77. Result ID: 698e3487ffc3901de09ba758. [Reporting paper]() Recorded evaluation configuration: {"System":"Microsoft.sd.6974"}. This record does not assert independent reproduction. ### NEU.6763 BLEU: 44.6. Result ID: 698e3487ffc3901de09ba75c. [Reporting paper]() Recorded evaluation configuration: {"System":"NEU.6763"}. This record does not assert independent reproduction. ### UCAM.6731 BLEU: 44.13. Result ID: 698e3487ffc3901de09ba75b. [Reporting paper]() Recorded evaluation configuration: {"System":"UCAM.6731"}. This record does not assert independent reproduction. ### Facebook.6862 BLEU: 43.64. Result ID: 698e3487ffc3901de09ba757. [Reporting paper]() Recorded evaluation configuration: {"System":"Facebook.6862"}. This record does not assert independent reproduction. ### General + In-Domain Pre-training BLEU: 42.2. Result ID: 698eb30cffc3901de09fe693. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input Adaptation":false,"In-Domain Pre-training":true}. This record does not assert independent reproduction. ### General + In-Domain Pre-training + Input Adaptation BLEU: 41.3. Result ID: 698eb30cffc3901de09fe694. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input Adaptation":true,"In-Domain Pre-training":true}. This record does not assert independent reproduction. ### General BLEU: 40.8. Result ID: 698eb30cffc3901de09fe691. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Pre-training":"General Domain (mBART25)"}. This record does not assert independent reproduction. ### General + Input Adaptation BLEU: 40.8. Result ID: 698eb30cffc3901de09fe692. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input Adaptation":true,"In-Domain Pre-training":false}. This record does not assert independent reproduction. ### Baseline BLEU: 39.4. Result ID: 698eb30cffc3901de09fe690. [Reporting paper]() Recorded evaluation configuration: {"description":"Standard Transformer model without pre-training"}. This record does not assert independent reproduction. ### +Online ST BLEU: 28.5. Result ID: 698ec020ffc3901de0a0b2e7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"MASS","Training Cost":"×1.1"}. This record does not assert independent reproduction. ### +CBD BLEU: 28.3. Result ID: 698ec020ffc3901de0a0b2e2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"XLM","Training Cost":"×7.3"}. This record does not assert independent reproduction. ### +Online ST BLEU: 28.3. Result ID: 698ec020ffc3901de0a0b2e3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"XLM","Training Cost":"×1.2"}. This record does not assert independent reproduction. ### +CBD BLEU: 28.3. Result ID: 698ec020ffc3901de0a0b2e6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MASS","Training Cost":"×7.3"}. This record does not assert independent reproduction. ### +Offline ST BLEU: 27.2. Result ID: 698ec020ffc3901de0a0b2e5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MASS","Training Cost":"×1.8"}. This record does not assert independent reproduction. ### +Offline ST BLEU: 26.9. Result ID: 698ec020ffc3901de0a0b2e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"XLM","Training Cost":"×1.8"}. This record does not assert independent reproduction. ### UNMT BLEU: 26.7. Result ID: 698ec020ffc3901de0a0b2e4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MASS","Training Cost":"1.0"}. This record does not assert independent reproduction. ### UNMT BLEU: 26.6. Result ID: 698ec020ffc3901de0a0b2e0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"XLM","Training Cost":"1.0"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.