WMT
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WMT News RU-EN 16
1Human Rank
2
WMT News EN-RU 16
2Human Rank
2
WMT 24++
85.2Score
1
WMT News CS-EN 16
1BLEU Rank
1
WMT
43.8Win Rate
1
WMT EN-DE 16
96Baseline Throughput (samples/s)
1
WMT EN-RO 16
8.7Baseline Throughput (samples/s)
1
WMT English-German 2017 (newstest14)
30.1BLEU
1
WMT French source 2017 newstest14 (test)
25EoE
1
WMT English-Czech 2019
0.5Preference: Much Better
1
WMT News RO-EN 16
2BLEU Rank
1
WMT16 News DE-EN
1BLEU Rank
1
WMT News EN-RO 16
2BLEU Rank
1
WMT News EN-DE 16
1BLEU Rank
1
WMT News EN-CS 16
1BLEU Rank
1
WMT De-En 21
—BLEU
0
WMT En-Ro 16
—BLEU
0
WMT fr-de 2019 (test)
—BLEU
0
WMT Ru-En 2020 (test)
—BLEU
0
WMT Zh-En 2018 (newstest18)
—BLEU
0