Machine Translation on WMT19 English-German (En-De) (test)
46.03BLEUMSRA.6926
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| MSRA.6926System=MSRA.69262021.07 | 46.03 | 45.04 | 61.87 | 72.67 | 15.25 | 21.4 | — | — | — | |
| Microsoft.dl.6808System=Microsoft.dl.68082021.07 | 44.83 | 45.91 | 61.32 | 72.6 | 15.44 | 29.6 | — | — | — | |
| Microsoft.sd.6974System=Microsoft.sd.69742021.07 | 44.77 | 45.83 | 60.56 | 72.63 | 15.39 | 31.1 | — | — | — | |
| NEU.6763System=NEU.67632021.07 | 44.6 | 45.63 | 60.83 | 72.29 | 15.21 | 20.8 | — | — | — | |
| UCAM.6731System=UCAM.67312021.07 | 44.13 | 46.36 | 60.47 | 71.9 | 15.19 | 21.3 | — | — | — | |
| Facebook.6862System=Facebook.68622021.07 | 43.64 | 46.92 | 60.77 | 72.19 | 15.55 | 34.7 | — | — | — | |
| General + In-Domain Pre-trainingInput Adaptation=false, In-Domain Pre-training=true2022.03 | 42.2 | — | — | — | — | — | 9.2 | — | — | |
| General + In-Domain Pre-training + Input AdaptationInput Adaptation=true, In-Domain Pre-training=true2022.03 | 41.3 | — | — | — | — | — | 4.1 | — | — | |
| GeneralPre-training=General Domain (mBART25)2022.03 | 40.8 | — | — | — | — | — | 3.3 | — | — | |
| General + Input AdaptationInput Adaptation=true, In-Domain Pre-training=false2022.03 | 40.8 | — | — | — | — | — | 2.7 | — | — | |
| Baselinedescription=Standard Transformer model without pre-training2022.03 | 39.4 | — | — | — | — | — | 2.6 | — | — | |
| +Online STBackbone=MASS, Training Cost=×1.12022.03 | 28.5 | — | — | — | — | — | — | 26.6 | 1.3 | |
| +CBDBackbone=XLM, Training Cost=×7.32022.03 | 28.3 | — | — | — | — | — | — | 26.3 | 1.2 | |
| +Online STBackbone=XLM, Training Cost=×1.22022.03 | 28.3 | — | — | — | — | — | — | 26.6 | 1.5 | |
| +CBDBackbone=MASS, Training Cost=×7.32022.03 | 28.3 | — | — | — | — | — | — | 26.2 | 0.9 | |
| +Offline STBackbone=MASS, Training Cost=×1.82022.03 | 27.2 | — | — | — | — | — | — | 25.4 | 0.1 | |
| +Offline STBackbone=XLM, Training Cost=×1.82022.03 | 26.9 | — | — | — | — | — | — | 25.1 | 0 | |
| UNMTBackbone=MASS, Training Cost=1.02022.03 | 26.7 | — | — | — | — | — | — | 25.3 | — | |
| UNMTBackbone=XLM, Training Cost=1.02022.03 | 26.6 | — | — | — | — | — | — | 25.1 | — |