Machine Translation on DE-EN
65.55BLEUTMPLM
Evaluation results
| Method | Links | |
|---|---|---|
| TMPLMModel Parameters=175B, Setting=Few-shot, k=5, Integration=LLM+TM2023.05 | 65.55 | |
| WMT21 champion model + TMModel Parameters=4B, Integration=NMT+TM, Baseline source=Reheman et al. (2023)2023.05 | 62.99 | |
| TMPLMModel Parameters=175B, Setting=One-shot, k=1, Integration=LLM+TM2023.05 | 62.23 | |
| WMT21 champion modelModel Parameters=4B, Integration=NMT Only2023.05 | 51.72 | |
| WMT19 champion model + TMModel Parameters=200M, Integration=NMT+TM, Baseline source=Reheman et al. (2023)2023.05 | 50.95 | |
| WMT19 champion modelModel Parameters=200M, Integration=NMT Only2023.05 | 45.9 | |
| davinci-003Model Parameters=175B, Setting=Zero-shot, Integration=LLM Only2023.05 | 40.75 | |
| ACPropBackbone=Transformer2021.10 | 35.35 | |
| AdaBeliefBackbone=Transformer2021.10 | 35.17 | |
| RAdamBackbone=Transformer2021.10 | 34.76 | |
| AdamBackbone=Transformer2021.10 | 34.66 | |
| AdaShiftBackbone=Transformer2021.10 | 30.18 |