MLQA
Benchmarks
TaskDatasetSOTA resultTrendResults
MLQA (test)
76.2F1 Score
35
MLQA v1.0 (test)
75.1F1 (es)
34
MLQA
84.8Average COMET Score
32
MLQA Retrieval
82.01nDCG@10
14
MLQA
0.671nDCG@20
12
MLQA
80F1 Score (es)
11
MLQA
2.21MAE
9
MLQA
2.42MAE
9
MLQA
84.5F1 (en)
8
MLQA G-XLT v1.0 (test)
67.7Avg Score
8
MLQA Chinese (test)
71.28BERTScore F1
7
MLQA Arabic (test)
86.18BERTScore F1
7
MLQA Zh
47.2Accuracy
6
MLQA German (de)
65.81F1 Score
5
MLQA English (en)
84.32F1 Score
5
MLQA Target - English v1.0 (test)
26.59EM (German)
4
MLQA English - Target v1.0 (test)
31.28German EM
4