MS MARCO
Benchmarks
TaskDatasetSOTA resultTrendResults
MS Marco
44.2NDCG@10
15
MS MARCO
4.89Target@5
14
MS MARCO passage (dev)
0.413NDCG@10
14
MS MARCO randomly selected 150 data points
100BAR
14
MS Marco 300k (dev)
0.603Hits@1
14
MS Marco 100k (dev)
70.74Hits@1
14
MS MARCO hye
84.05Score
13
MS MARCO In-domain suite (TREC DL19, TREC DL20) v1 (dev test)
0.48NDCG@10 (Sparse, BM25, MS MARCO)
13
MS MARCO
0.408NDCG@10
12
MS MARCO Document 200 sampled queries (test)
93Top-5 Success Rate
12
MS MARCO DL2020
75.2NDCG@10
12
MS MARCO (eval)
0.359MRR@10
12
MS-MARCO new documents
0.772R@10
11
MS-MARCO initial documents
0.775R@10
11
MS MARCO Passage Ranking 7k queries (dev)
39.7MRR@10
11
MS MARCO
11.9BLEU Score
11
MS MARCO Document v1 (dev)
41MRR@100
11
MS MARCO v1 (dev)
51.5nDCG@10
10
MS-MARCO (test)
57.85Accuracy
10
MS MARCO small (dev)
41.1MRR@10
10
MS MARCO
72.86Recall
9
MS MARCO (val)
26.7ROUGE-L
9
MS MARCO c (test)
0.57Latency p50 (s)
9
MS MARCO b (test)
0.55Latency P50 (s)
9
MS-MARCO (test)
47ROUGE-L
9