WMT
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WMT Zh-En 2022 (test)
33.5SacreBLEU
8
WMT News EMNLP2017
5.24LM Score
8
WMT En-De (De ← En) 20 (test)
27.8BLEU
8
WMT En-De 20 (test)
24.3BLEU
8
WMT En-De 19 (test)
0.261BLEU Score
8
WMT 19 and 20
25.9Average SacreBLEU
8
WMT 20
23SacreBLEU (Source->Target)
8
WMT 19
27.7SacreBLEU (Source->Target)
8
WMT20 JA-EN (test)
21.5BLEU
8
WMT 2014 (test)
29BLEU
8
WMT'14 EN-DE (val)
4.87Validation Perplexity
8
WMT EN-DE '14 (train)
3.87Training Perplexity
8
WMT En-De 2015
33.8BLEU
8
WMT En-De 2012
25.19BLEU
8
WMT En-De 2011
24.34BLEU Score
8
WMT En-De 2010
26.65BLEU
8
WMT RO-EN 2016 (dev)
35.78BLEU Score
8
WMT English-French (test)
43.8BLEU
8
WMT English-Romanian (EN-RO) 2016
35.45BLEU Score
7
WMT English-Romanian (EN-RO) '16
4.6Relative Decoding Speed
7
WMT German-English 2014
5.5Relative Decoding Speed
7
WMT English-German 2014
5.1Relative Decoding Speed
7
WMT News Commentary and IWSLT (En-It) 25
89.99COMET Score
7
WMT News Commentary and IWSLT (En-Es) 25
88.51COMET Score
7
WMT EN-DE
26.28BLEU Score
7