MsMARCO
Benchmarks
TaskDatasetSOTA resultTrendResults
MSMARCO (dev)
42.6MRR@10
116
MSMarco (dev)
43.2NDCG@10
41
MSMARCO
88Latency (ms)
18
MsMARCO (test)
40.7ROUGE Score
18
MSMARCO (test)
53.3F1 Score
17
MSMARCO (clean)
94.5Accuracy
16
MSMARCO v1 (test)
156Latency @ 90% Acc (µs)
16
MSMARCO Out-of-distribution (test)
46.2Accuracy
15
MSMARCO
53.9ROUGE-L
15
MSMARCO streaming topic-clustered Average
76.37Success@5
14
MSMARCO streaming topic-clustered (Session 9)
92.2Success@5
14
MSMARCO streaming topic-clustered (Session 8)
92.6Success@5
14
MSMARCO streaming topic-clustered (Session 7)
91.9Success@5
14
MSMARCO streaming topic-clustered (Session 6)
89.3Success@5
14
MSMARCO streaming topic-clustered (Session 5)
90Success@5
14
MSMARCO streaming topic-clustered (Session 4)
65.9Success@5
14
MSMARCO streaming topic-clustered (Session 3)
68.9Success@5
14
MSMARCO streaming topic-clustered (Session 2)
66.7Success@5
14
MSMARCO streaming topic-clustered (Session 1)
69.3Success@5
14
MSMARCO streaming topic-clustered (Session 0)
60.6Success@5
14
MSMARCO
96.32S@5
14
MSMARCO Wiki-answerable
57.2ROUGE-L
14
MSMARCO
99ASRr
12
MSMARCO (test)
82.26MO@10
12
MsMARCO (dev)
57.2ROUGE Score
11