FLORES
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
FLoRes+ XX-En mid resource level
58.3ChrF++
16
FLoRes+ XX-En, high resource level
65ChrF++
16
FLORES-200 Source language en
48.2MT Score
16
FLORES non-EU languages (test)
89Score
16
FLORES en->xx
-1.9Quality (en->de)
16
FLORES xx→en
-45.2de->en Score
16
Long FLORES uk to en (test)
27.89BLEU
14
Long FLORES en to uk (test)
14.36BLEU
14
FLORES 24 official EU languages
88.9Score
14
FLORES200 EN-FI
62.57chrF++
13
FLORES-200 (test)
76.9Mean Perplexity
12
FLORES-200 eng → nya
13.82BLEU
12
FLORES-200 nya → eng
27.84BLEU
12
Flores 101 (x-y)
30.5BLEU Score
12
FLORES-AE33 Type I (test)
1.8MAE
12
FLORES-200 (dev+devtest)
1.43Per-word Fertility (En)
11
FLORES-200 EN-ET (test)
13.1BLEU
11
FLORES-200 EN-FI (test)
9.9BLEU
11
FLORES-200 EN-TR (test)
12.1BLEU
11
FLORES-200 EN-RU (test)
13.1BLEU Score
11
FLORES-200 EN-DE (test)
23.5BLEU
11
FLORES-200 ET-EN (test)
17.5BLEU
11
FLORES-200 FI-EN (test)
15.8BLEU
11
FLORES-200 RU-EN (test)
22.8BLEU
11
FLORES-200 DE-EN (test)
31.2BLEU
11