MKQA
Benchmarks
TaskDatasetSOTA resultTrendResults
MKQA
47.6fEM
27
MKQA
76.6Avg. Recall@100
27
MKQA 1.0 (test)
0.626Accuracy (AR)
18
MKQA (test)
0.82AUROC
14
MKQA Average across languages
45.92fEM
14
MKQA Arabic
24.12fEM
14
MKQA Thai
27.83fEM
14
MKQA French
59.67fEM
14
MKQA English
72.07fEM
14
MKQA
15.94Accuracy
12
MKQA (full)
29.9Retrieval Accuracy
12
MKQA (test)
52.3F1-score (All)
10
MKQA
27.92chrF
9
MKQA (test)
49.93-gram Recall
8
MKQA
57.82Composite Score (ALL-AVG)
6
MKQA eng
15.1nDCG@1
6
MKQA Japanese ja (test)
83AUROC
5
MKQA Russian / ru (test)
80AUROC
5
MKQA Spanish es (test)
82AUROC
5
MKQA eng
35.2nDCG@10
5
MKQA English Language (test)
45.42NOB Accuracy
5
MKQA Target Language (test)
40.64NOB Accuracy
5
MKQA Khmer (km)
18LC
3
MKQA Norwegian (no)
9LC Score
3
MKQA Japanese
77AUROC
2