WMT
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WMT En-Hr 22
86.9COMET
16
WMT Cs-Uk 22
90.2COMET Score
16
WMT En-Ja 22
88.7COMET
16
WMT en→zh (test)
44.9BLEU
16
WMT de-en
33.87BLEU
16
WMT all 54 LPs 24++
0.623SLI
15
WMT (document-level) Low Resource X→En 24++
83.72COMET-22 Score
15
WMT (document-level) Low Resource En→X 24++
82.92COMET-22
15
WMT document-level Medium Resource X→Zh 24++
85.29COMET-22 Score
15
WMT (document-level) Medium Resource Zh→X 24++
86.73COMET-22 Score
15
WMT document-level High Resource X→Zh 24++
85.3COMET-22 Score
15
WMT (document-level) High Resource Zh→X 24++
84.21COMET-22
15
WMT24++ (test)
77.8en-ar Score
15
WMT en-de 22
0.722Pearson R
15
WMT news 2014 (test)
28.58BLEU
15
WMT newstest 2013 (test)
26.85BLEU Score
15
WMT newstest 2012 (test)
22.92BLEU Score
15
WMT newstest 2011 (test)
22.51BLEU
15
WMT Ukrainian (test)
4.71BLEU
14
WMT 24++
72.86AR Score
14
WMT 20
19.2SacreBLEU
14
WMT 20
27SacreBLEU
14
WMT 18
18.6SacreBLEU
14
WMT 18
22.8SacreBLEU
14
WMT Romanian-English 2016
43.8BLEU
14