# Machine Translation on WMT English-German (EN-DE) 2014 (newstest2014) Source: [Machine Translation on WMT English-German (EN-DE) 2014 (newstest2014)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:36:51.401Z Evaluation of Machine Translation performance on the WMT 2014 English-German (EN-DE) newstest2014 set, measured by BLEU score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Machine Translation | | Dataset (including any stated split) | WMT English-German (EN-DE) 2014 (newstest2014) | | Metric | BLEU | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 29 of 29 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [BLEU](): Higher is better; unit: PERCENT. - [SacreBLEU](): Higher is better; unit: PERCENT. ## Recorded results | Method | BLEU | Result date | Report paper | | --- | --- | --- | --- | | RK2-block (learnable gamma\_i) | 30.77 | Not recorded | 68fa6c351e209131cea32d25 | | BERT-fused model | 30.75 | Not recorded | 68fa6c351e209131cea32d25 | | RK2-block | 30.58 | Not recorded | 68fa6c351e209131cea32d25 | | Multiscale Collaborative | 30.56 | Not recorded | 68fa6c351e209131cea32d25 | | RK4-block | 30.55 | Not recorded | 68fa6c351e209131cea32d25 | | RK2-block (learnable gamma\_i) | 30.53 | Not recorded | 68fa6c351e209131cea32d25 | | RK4-block | 30.39 | Not recorded | 68fa6c351e209131cea32d25 | | RK2-block (learnable gamma\_i) | 30.29 | Not recorded | 68fa6c351e209131cea32d25 | | SDT | 30.21 | Not recorded | 68fa6c351e209131cea32d25 | | MacaronNet | 30.2 | Not recorded | 68fa6c351e209131cea32d25 | | RK2-block | 30.11 | Not recorded | 68fa6c351e209131cea32d25 | | ADMIN | 30.01 | Not recorded | 68fa6c351e209131cea32d25 | | Depth growing | 29.92 | Not recorded | 68fa6c351e209131cea32d25 | | Residual-block-Big | 29.91 | Not recorded | 68fa6c351e209131cea32d25 | | RK2-block | 29.85 | Not recorded | 68fa6c351e209131cea32d25 | | RK4-block | 29.8 | Not recorded | 68fa6c351e209131cea32d25 | | Residual-block | 29.43 | Not recorded | 68fa6c351e209131cea32d25 | | Transformer-DLCL | 29.3 | Not recorded | 68fa6c351e209131cea32d25 | | Residual-block-Big | 29.21 | Not recorded | 68fa6c351e209131cea32d25 | | RK4-block | 29.03 | Not recorded | 68fa6c351e209131cea32d25 | | RK2-block (learnable gamma\_i) | 28.89 | Not recorded | 68fa6c351e209131cea32d25 | | RK2-block | 28.67 | Not recorded | 68fa6c351e209131cea32d25 | | Transformer | 28.4 | Not recorded | 68fa6c351e209131cea32d25 | | Residual-block | 27.89 | Not recorded | 68fa6c351e209131cea32d25 | | Transformer (base) | 27.3 | Not recorded | 68fa6a1e1e209131cea260f7 | | ResMLP-12 | 26.8 | Not recorded | 68fa6a1e1e209131cea260f7 | | ResMLP-6 | 26.4 | Not recorded | 68fa6a1e1e209131cea260f7 | | ConvS2S | 25.2 | Not recorded | 68fa6a1e1e209131cea260f7 | | GNMT | 24.6 | Not recorded | 68fa6a1e1e209131cea260f7 | ### RK2-block (learnable gamma\_i) BLEU: 30.77. Result ID: 698ef6e03a6c314849f416b7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"12-6","#Param":"286M","Steps":"100K"}. This record does not assert independent reproduction. ### BERT-fused model BLEU: 30.75. Result ID: 698ef6e03a6c314849f416a8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"6-6"}. This record does not assert independent reproduction. ### RK2-block BLEU: 30.58. Result ID: 698ef6e03a6c314849f416b6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"12-6","#Param":"286M","Steps":"100K"}. This record does not assert independent reproduction. ### Multiscale Collaborative BLEU: 30.56. Result ID: 698ef6e03a6c314849f416a5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Layers":"18-6","#Param":"512M","Steps":"300K"}. This record does not assert independent reproduction. ### RK4-block BLEU: 30.55. Result ID: 698ef6e03a6c314849f416b8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"12-6","#Param":"286M","Steps":"100K"}. This record does not assert independent reproduction. ### RK2-block (learnable gamma\_i) BLEU: 30.53. Result ID: 698ef6e03a6c314849f416b3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"6-6","#Param":"211M","Steps":"100K"}. This record does not assert independent reproduction. ### RK4-block BLEU: 30.39. Result ID: 698ef6e03a6c314849f416b4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"6-6","#Param":"211M","Steps":"100K"}. This record does not assert independent reproduction. ### RK2-block (learnable gamma\_i) BLEU: 30.29. Result ID: 698ef6e03a6c314849f416af. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"24-6","#Param":"118M","Steps":"50K"}. This record does not assert independent reproduction. ### SDT BLEU: 30.21. Result ID: 698ef6e03a6c314849f416a7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Layers":"48-6","#Param":"192M","Steps":"50K"}. This record does not assert independent reproduction. ### MacaronNet BLEU: 30.2. Result ID: 698ef6e03a6c314849f416a2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Layers":"6-6"}. This record does not assert independent reproduction. ### RK2-block BLEU: 30.11. Result ID: 698ef6e03a6c314849f416b2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"6-6","#Param":"211M","Steps":"100K"}. This record does not assert independent reproduction. ### ADMIN BLEU: 30.01. Result ID: 698ef6e03a6c314849f416a6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"60-12","#Param":"262M","Steps":"250K"}. This record does not assert independent reproduction. ### Depth growing BLEU: 29.92. Result ID: 698ef6e03a6c314849f416a3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"8-8","#Param":"270M","Steps":"800K"}. This record does not assert independent reproduction. ### Residual-block-Big BLEU: 29.91. Result ID: 698ef6e03a6c314849f416b5. [Reporting paper]() Recorded evaluation configuration: {"Layers":"12-6","#Param":"286M","Steps":"100K"}. This record does not assert independent reproduction. ### RK2-block BLEU: 29.85. Result ID: 698ef6e03a6c314849f416ae. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"24-6","#Param":"118M","Steps":"50K"}. This record does not assert independent reproduction. ### RK4-block BLEU: 29.8. Result ID: 698ef6e03a6c314849f416b0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"24-6","#Param":"118M","Steps":"50K"}. This record does not assert independent reproduction. ### Residual-block BLEU: 29.43. Result ID: 698ef6e03a6c314849f416ad. [Reporting paper]() Recorded evaluation configuration: {"Layers":"24-6","#Param":"118M","Steps":"50K"}. This record does not assert independent reproduction. ### Transformer-DLCL BLEU: 29.3. Result ID: 698ef6e03a6c314849f416a4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Layers":"30-6","#Param":"137M","Steps":"50K"}. This record does not assert independent reproduction. ### Residual-block-Big BLEU: 29.21. Result ID: 698ef6e03a6c314849f416b1. [Reporting paper]() Recorded evaluation configuration: {"Layers":"6-6","#Param":"211M","Steps":"100K"}. This record does not assert independent reproduction. ### RK4-block BLEU: 29.03. Result ID: 698ef6e03a6c314849f416ac. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"6-6","#Param":"61M","Steps":"50K"}. This record does not assert independent reproduction. ### RK2-block (learnable gamma\_i) BLEU: 28.89. Result ID: 698ef6e03a6c314849f416ab. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"6-6","#Param":"61M","Steps":"50K"}. This record does not assert independent reproduction. ### RK2-block BLEU: 28.67. Result ID: 698ef6e03a6c314849f416aa. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"6-6","#Param":"61M","Steps":"50K"}. This record does not assert independent reproduction. ### Transformer BLEU: 28.4. Result ID: 698ef6e03a6c314849f416a1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"6-6","#Param":"213M","Steps":"100K"}. This record does not assert independent reproduction. ### Residual-block BLEU: 27.89. Result ID: 698ef6e03a6c314849f416a9. [Reporting paper]() Recorded evaluation configuration: {"Layers":"6-6","#Param":"61M","Steps":"50K"}. This record does not assert independent reproduction. ### Transformer (base) BLEU: 27.3. Result ID: 698e1012ffc3901de09a7f75. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ResMLP-12 BLEU: 26.8. Result ID: 698e1012ffc3901de09a7f77. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"layers":"12","dimension":"512","hidden MLP size":"2,048"}. This record does not assert independent reproduction. ### ResMLP-6 BLEU: 26.4. Result ID: 698e1012ffc3901de09a7f76. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"layers":"6","dimension":"512","hidden MLP size":"2,048"}. This record does not assert independent reproduction. ### ConvS2S BLEU: 25.2. Result ID: 698e1012ffc3901de09a7f74. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GNMT BLEU: 24.6. Result ID: 698e1012ffc3901de09a7f73. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.