FLORES
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
FLORES+
49.57ChrF++
11
FLORES+
60.04ChrF++
11
FLORES+ (evaluation)
67.27ChrF++
11
Flores-101
31.4spBLEU
11
FLORES+
56.19ChrF++
10
FLORES+
49.68ChrF++
10
Flores focus languages
19am
10
Flores Bitext Mining
19.55F1 Score
10
FLores De→En 0-shot
45.25spBLEU
10
FLores En→De 0-shot
39.83spBLEU
10
Flores (dev)
41.49spBLEU (En ->)
10
FLORES-200 ordered 41,412 directions
16.4Wins Count
9
FLORES+
46.1chrF++
9
FLORES-200
202Perplexity Win Rate
9
FLORES-200 ET-EN
41.2BLEU
9
FLORES-200 EN-ET
29BLEU
9
FLORES European 20 language pairs
20.61Average Score
9
FLORES
0.509Mean MEXA Score
9
FLORES
71.2Accuracy
9
FLORES200 Full 201
27xSim Score
8
FLORES200 Common langs (80)
13.3xSim
8
FLORES+ (devtest)
99.98Loose Accuracy
8
FLORES ET-EN v1 (test)
0.831COMET
8
FLORES EN-ET v1 (test)
83.5COMET
8
Flores-200 (test)
88.9COMET
8