MIRACL
Benchmarks
TaskDatasetSOTA resultTrendResults
MIRACL (dev)
72.3Avg Score
51
MIRACL (dev)
49NDCG@10
41
MIRACL
0.423nDCG@10
24
MIRACL Vision
0.72Chinese
17
MIRACL (Evaluation set)
71.7nDCG@10
14
MIRACL
92.9nDCG@10
12
MIRACL Hard Negative
22nDCG@10 (Hindi)
12
MIRACL RetrievalHardNegatives
70.4Average Performance
9
MIRACL
70.07Average nDCG@10
8
MIRACL zero-shot
57.4nDCG@10 (ar)
8
MIRACL European Languages
95.1nDCG@10
8
MIRACL zh
33.66nDCG@10
7
MIRACL Swahili (dev)
0.108Δ nDCG@10
6
MIRACL Bengali (dev)
0.727NDCG@10
6
MIRACL Pseudo
86.53AUC
5
MIRACL Original
0.824AUC
5
MIRACL-VC1 (test)
98Test Accuracy
5
MIRACL Telugu (dev)
0.494NDCG@10
4
MIRACL Hindi (dev)
48.3NDCG@10
4
MIRACL VC1
99.8Sensitivity
1