WMT
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WMT 14
94.18BLEU
5
WMT-CS-UK
25.8BLEU
5
WMT EN-CS
31.4BLEU
5
WMT EN-ZH
49.4BLEU
5
WMT RU-EN 2021 (test)
47.16Pearson Correlation
5
WMT RO-EN 2021 (test)
84.4Pearson Correlation
5
WMT EN-ZH 2021 (test)
0.366Pearson Correlation
5
WMT EN-DE 2021 (test)
51.9Pearson Correlation
5
WMT 22 (test)
35.3BLEU
5
WMT De-En 21
176.67MQM Score
5
WMT EN-JA 22
90.2COMET Score
5
WMT EN-RU 22
89.5COMET
5
WMT22 RU-EN
86.6COMET Score
5
WMT EN-DE 22
88.1COMET Score
5
WMT DE-EN 22
85.8COMET
5
WMT EN-JA 22 (test)
37.6ChrF
5
WMT EN-RU 22 (test)
59.6ChrF
5
WMT Domain 21
0.65Correlation
5
WMT14 German-English
85.29Lex. CSR
5
WMT
57.6Overall Score (en-*)
5
WMT14 En-De (newstest)
28.26BLEU
5
WMT19 En-De (test)
35HQ Score (R)
5
WMT En-De (S) Multiple References 19 (test)
75.6BLEU
5
WMT En-De Multiple References 19 (test)
80.1BLEU
5
WMT De-En 19 (test)
41.4BLEU
5