Machine Translation on WMT en-de 16 (test)
41.2BLEUFinetuned SOTA
Evaluation Results
| Method | Links | |
|---|---|---|
| Finetuned SOTASetting=Supervised2022.08 | 41.2 | |
| PaLM 540BSetting=Few-shot, Model Size=540B, Shot Count=52022.08 | 37.4 | |
| AlexaTM 20BSetting=Few-shot, Model Size=20B, Shot Count=32*2022.08 | 35.23 | |
| PaLM 540BSetting=0-shot, Model Size=540B2022.08 | 31.8 | |
| PaLM 540BSetting=1-shot, Model Size=540B2022.08 | 31.8 | |
| GPT3 175BSetting=Few-shot, Model Size=175B, Shot Count=642022.08 | 29.7 | |
| MEGA2022.09 | 29.18 | |
| AlexaTM 20BSetting=1-shot, Model Size=20B2022.08 | 29.02 | |
| Transformer (XFM)2022.09 | 27.97 | |
| GPT3 175BSetting=1-shot, Model Size=175B2022.08 | 26.2 | |
| GPT3 175BSetting=0-shot, Model Size=175B2022.08 | 24.6 | |
| XGLM 7.5BSetting=Few-shot, Model Size=7.5B2022.08 | 23.5 | |
| AlexaTM 20BSetting=0-shot, Model Size=20B2022.08 | 21.64 |