List your company
ResearchFormerly WizWand

Machine Translation on WMT

3.2PPLTeacher
1.63612.19322.7533.307Sep 15, 2020
Updated 8mo ago

Evaluation results

MethodLinks
TeacherModel=Transf. (8-layer)2020.093.228.729.2
Vanilladata=Full2020.095.223.824.5
Vanilla2020.095.52223.1
SeqKDdata=Full2020.095.624.725.3
ImitKDdata=Full2020.095.625.325.9
ImitKD*data=Full, training=student/teacher dataset mixture2020.095.62525.8
ImitKD2020.097.424.625.5
ImitKD*training=student/teacher dataset mixture2020.098.425.325.8
SeqKD2020.09924.925.5
ImitKDdata=25x less data2020.091517.819
ImitKD*data=25x less data, training=student/teacher dataset mixture2020.0917.818.619.5
Vanilladata=25x less data2020.0918.713.815.1
SeqKDdata=25x less data2020.0942.317.117.9