List your company
ResearchFormerly WizWand

Machine Translation on WMT en-de 16 (test)

41.2BLEUFinetuned SOTA
20.857626.138831.4236.7012Aug 2, 2022Aug 10, 2022Aug 18, 2022Aug 27, 2022Sep 4, 2022Sep 12, 2022Sep 21, 2022
Updated 8mo ago

Evaluation results

MethodLinks
Finetuned SOTASetting=Supervised2022.0841.2
PaLM 540BSetting=Few-shot, Model Size=540B, Shot Count=52022.0837.4
AlexaTM 20BSetting=Few-shot, Model Size=20B, Shot Count=32*2022.0835.23
PaLM 540BSetting=0-shot, Model Size=540B2022.0831.8
PaLM 540BSetting=1-shot, Model Size=540B2022.0831.8
GPT3 175BSetting=Few-shot, Model Size=175B, Shot Count=642022.0829.7
MEGA2022.0929.18
AlexaTM 20BSetting=1-shot, Model Size=20B2022.0829.02
Transformer (XFM)2022.0927.97
GPT3 175BSetting=1-shot, Model Size=175B2022.0826.2
GPT3 175BSetting=0-shot, Model Size=175B2022.0824.6
XGLM 7.5BSetting=Few-shot, Model Size=7.5B2022.0823.5
AlexaTM 20BSetting=0-shot, Model Size=20B2022.0821.64