List your company
ResearchFormerly WizWand

Machine Translation on WMT En-De 2016

41.2BLEUSupervised Model
6.3615.40524.4533.495Apr 5, 2021Apr 30, 2021May 25, 2021Jun 19, 2021Jul 14, 2021Aug 8, 2021Sep 3, 2021
Updated 8mo ago

Evaluation results

MethodLinks
Supervised Modelmode=supervised2021.0941.2
FLAN 137Bprotocol=few-shot, template_selection=best dev, k=11, number_of_templates=32021.0940.7
GPT-3 175Bprotocol=few-shot, k=642021.0940.6
FLAN 137Bprotocol=few-shot, template_selection=average, k=11, number_of_templates=32021.0940.6
FLAN 137Bprotocol=zero-shot, template_selection=average, number_of_templates=32021.0938.9
FLAN 137Bprotocol=zero-shot, template_selection=best dev, number_of_templates=32021.0938.9
Supervised Modelmode=supervised2021.0938.6
REP(SIM)+WDROPPositions=both2021.0437.96
REP(UNI)Positions=both2021.0437.73
REP(UNI)+WDROPPositions=both2021.0437.68
WDROPPositions=both2021.0437.65
REP(SIM)Positions=both2021.0437.4
ADVPositions=both2021.0437.2
LaMDA-PTprotocol=few-shot, k=52021.0936.8
REP(SS)Positions=dec2021.0436.59
w/o perturbation2021.0436.47
GPT-3 175Bprotocol=few-shot, k=642021.0929.7
GPT-3 175Bprotocol=zero-shot2021.0927.2
FLAN 137Bprotocol=zero-shot, template_selection=best dev, number_of_templates=52021.0927
FLAN 137Bprotocol=few-shot, template_selection=average, k=11, number_of_templates=52021.0926.8
LaMDA-PTprotocol=few-shot, k=52021.0926.7
FLAN 137Bprotocol=few-shot, template_selection=best dev, k=11, number_of_templates=52021.0926.1
FLAN 137Bprotocol=zero-shot, template_selection=average, number_of_templates=52021.0925.4
GPT-3 175Bprotocol=zero-shot2021.0924.6
LaMDA-PTprotocol=zero-shot2021.0920.8
LaMDA-PTprotocol=zero-shot2021.097.7