MS MARCO
Benchmarks
TaskDatasetSOTA resultTrendResults
MS MARCO
0.433D (MRR@10)
21
MS-MARCO
90.7ASR
20
MS-MARCO (dev)
38.3MRR@10
20
MS MARCO
34.44BLEU-1
20
MS MARCO TREC DL19 1.0 (test)
0.648nDCG@10
20
MS MARCO
97.1Recall
20
MS MARCO TREC Deep Learning
0.713DL19 Score
18
MS MARCO Document DL19
72.1nDCG@10
18
MS MARCO in-domain
0.473NDCG@10
18
MS MARCO BEIR
47NDCG@10
17
MS MARCO (dev)
0.452MRR@10
17
MS MARCO (dev)
43.1MRR@10
17
MS-MARCO
74Accuracy (Clean)
16
MS-MARCO
100wAA (%)
16
MS MARCO
74.35Score D0
16
MS-MARCO
98ATR
16
MS-MARCO Passage (Mixture)
34.5SRR@100
15
MS-MARCO Passage (Hard)
31.2SRR@100
15
MS-MARCO Passage (Middle)
46.2SRR@100
15
MS-MARCO Passage Easy
51SRR@100
15
MS-MARCO Document (Mixture)
36.1SRR@10
15
MS-MARCO Document (Hard)
34.9SRR@10
15
MS-MARCO Document (Middle)
51.9SRR@10
15
MS-MARCO Document (Easy)
55.8SRR@10
15
MS MARCO (dev)
40MRR@10
15