WMT
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WMT English-Romanian 16
33.4BLEU
7
WMT De-En Medical 19
20.01SacreBLEU
7
WMT De-En (IT) 19
12.49SacreBLEU
7
WMT De-En Koran 19
7.4SacreBLEU
7
WMT De-En News 19
21.86SacreBLEU
7
WMT ja-en '23
88.5COMET
7
WMT en-ja '23
91.9COMET
7
WMT average '22 (test)
85.8COMET Score
7
WMT'22 en-de (test)
87COMET Score
7
WMT Zh-En subset of 300 sentences 2022 (test)
2Δ Under-translation
7
WMT 2016, 2019, 2020 (test)
33.5Score (Ro)
7
WMT150 En-Zh (test)
26.4PER
7
WMT DE-EN 18 (test)
91.72AUROC
7
WMT (test)
28.5En-De Score
7
WMT 2020 (test)
73Agreement (en-cs)
7
WMT de-fr 2019 (test)
31.5BLEU
7
WMT Under-Resourced EN-FR 2014
26.9BLEU
7
WMT Under-Resourced EN-DE 2014
17.7BLEU
7
WMT Well-Resourced EN-FR 2014
40BLEU
7
WMT Well-Resourced EN-DE 2014
28BLEU Score
7
WMT17 En-Tr (newstest2017)
16.66BLEU
7
WMT En-De Full set 16
36.3BLEU
7
WMT English-German newstest2014 (test)
30.91BLEU
7
WMT 2016 (test)
36.5BLEU
7
WMT Romanian-English news 2016 (dev)
19Inference Time (s)
7