MS MARCO
Benchmarks
TaskDatasetSOTA resultTrendResults
MS-MARCO
100ASR
5
MS MARCO Hybrid Annotation
79.19MRR@10
5
MS MARCO DL20
0.632NDCG@10
5
MS MARCO DL19
95.1Recall@1000
5
MS MARCO
0.46Kendall's Tau
5
MS MARCO (dev)
0.416MRR@10
5
MS MARCO (test)
36.8MRR@10
5
MS-MARCO
6.2Average Latency (s)
4
MS MARCO 200 queries (dev)
0.401MRR@10
4
MS MARCO
29.7nDCG@10
4
MS MARCO passage ranking
34.6Peak Memory (GB)
4
MS MARCO Passage Ranking
98.7Recall@1000
4
MS-MARCO
0.61Memory (GB)
4
MS-MARCO
24.75R@1
4
MS MARCO v1
2.886Recall@1
4
MS MARCO
0.63Latency (s/query)
4
MS MARCO Passage Ranking 5k queries (Local Eval)
40.8MRR@10
4
MS MARCO Web Search
1MRR
4
MS MARCO MQA (test val)
69.4F1 Score
4
MS-MARCO
87.7Accuracy
4
MS MARCO (dev)
46.14ROUGE
4
MS MARCO Passage
34.71Mean NDCG@5
3
MS MARCO passage ranking 100K passages (dev-small)
89.2MRR@10
3
MS MARCO 8.8M passages
38.3MRR@10
3
MS MARCO (test)
82.7Found Percentage
3