newstest
Benchmarks
TaskDatasetSOTA resultTrendResults
newstest 2010-2016 (test)
27.57BLEU
32
newstest 18 (head150)
0.579ChrF
20
newstest Average 2010-2016
27.57BLEU
14
newstest 2010
24.92BLEU
14
newstest head150 2018 (test)
87.1ChrF
12
newstest FI-EN 2019 (test)
33BLEU
11
newstest FI-EN 2018 (val)
26.7BLEU Score
11
newstest En-De 2015 (test)
25.44BLEU
11
newstest En-De 2013 (dev)
23.49BLEU
10
newstest English-German 2015 (test)
28.7BLEU
8
German-English newstest 2013 (dev)
44.1Perplexity
8
newstest En-Fi 2015 (test)
13.48BLEU
7
newstest En-Ru 2015 (test)
24.3BLEU
7
newstest En-Ru 2014 (test)
29.37BLEU
7
newstest En-Cs 2015 (test2)
18.93BLEU
7
newstest En-Cs 2014 (test)
22.15BLEU
7
NEWSTEST En -> Zh 2021
64.62BLEURT
6
newstest En-Ru 2013 (dev)
21.17BLEU
6
newstest En-Cs 2013 (dev)
0.198BLEU
6
newstest English-Russian 2015 (test)
24.3BLEU (single)
6
newstest French-to-English 2014 (test)
37.59BLEU
5
newstest French-to-English 2013 (test)
34.26BLEU
5
newstest English-to-French 2013 (test)
34.67BLEU
5
newstest German-to-English 2014 (test)
32.18BLEU
5
newstest German-to-English 2013 (test)
31.46BLEU
5