MS MARCO
Benchmarks
TaskDatasetSOTA resultTrendResults
MS MARCO (dev)
0.401MRR@10
84
MS-MARCO
91Accuracy
78
MS MARCO (dev)
77.1MRR@10
75
MS MARCO (dev)
41.4MRR@10
71
MS MARCO v1
0.5Retrieval Latency (ms)
66
MS MARCO (test)
0.714NDCG@10
56
MS MARCO
93NDCG@10
56
MS MARCO
100Recall@1
50
MS MARCO
90Accuracy (Clean)
45
MS MARCO
82.04E2E Attack Success Rate
36
MS MARCO MS300K (test)
57.6MRR@10
36
MS MARCO
99.8Recall@5
35
MS-MARCO
0.8Attack Success Rate (ASR)
35
MS MARCO document retrieval (DL'19)
73NDCG@10
32
MS-MARCO
85ASR
30
MS MARCO
34.96Word Score
30
MS-MARCO
97Precision
26
MS MARCO DL2019
74.6nDCG@10
26
MS MARCO Document
45.9MRR@10
26
MS MARCO Passage
0.437MRR@10
26
MS MARCO document retrieval (DL'20)
72NDCG@10
25
MS MARCO Document
74FD (%)
24
MS MARCO Passage
82FD (%)
24
MS MARCO
92Substring ASR
24
MS MARCO Document (dev)
0.479MRR@100
24