MS MARCO
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MS Marco
100Coverage
3
MS-MARCO
35.28BLEU-1
3
MS-MARCO MultiTurn
54ASR
3
MS-MARCO Gemma-Human (dev)
64.51Human F1
3
MS-MARCO passage ranking August 11, 2021 (test)
42.8MRR@10
3
MS MARCO (test)
30BLEU-1
3
MS MARCO (test)
18Preference: FiD
3
MS MARCO (evaluation)
2.7Fluency
2
MS MARCO ColBERTv2 embeddings 100K passages
1.4V2-MQ (ms)
1
MS MARCO 1M passages
70.3MRR@10
1
MS-MARCO
88.4Poisoned RAG F1
1
MS-MARCO
—Primary metric
0