Web Search Retrieval on MS MARCO (dev)
0.452MRR@10RepLLaMA + RankLLaMA-13B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RepLLaMA + RankLLaMA-13BRetriever Type=Advanced multi-stage2025.06 | 0.452 | 0.994 | |
| query2docRetriever Type=Advanced dense, Base Retriever=SimLM2025.06 | 0.415 | 0.988 | |
| SimLMRetriever Type=Advanced dense2025.06 | 0.411 | 0.987 | |
| SPLADE + ColBERT/BKLRetriever Type=Advanced multi-stage2025.06 | 0.407 | 0.982 | |
| Exp4FuseRetriever Type=Learned sparse, Base Retriever=SPLADE++-v12025.06 | 0.398 | 0.986 | |
| Exp4FuseRetriever Type=Learned sparse, Base Retriever=SPLADE++-v22025.06 | 0.396 | 0.989 | |
| uniCOIL + ColBERTv2/CQRetriever Type=Advanced multi-stage2025.06 | 0.387 | 0.958 | |
| coCondenserRetriever Type=Advanced dense2025.06 | 0.382 | 0.984 | |
| SPLADE++-v1Retriever Type=Learned sparse, Augmentation=None2025.06 | 0.369 | 0.979 | |
| SPLADE++-v2Retriever Type=Learned sparse, Augmentation=None2025.06 | 0.368 | 0.98 | |
| Exp4FuseRetriever Type=Learned sparse, Base Retriever=uniCOIL2025.06 | 0.364 | 0.974 | |
| uniCOILRetriever Type=Learned sparse, Augmentation=None2025.06 | 0.35 | 0.958 | |
| TAS-BRetriever Type=Advanced dense2025.06 | 0.34 | 0.975 | |
| Exp4FuseRetriever Type=Basic sparse, Base Retriever=docT5query2025.06 | 0.287 | 0.964 | |
| docT5queryRetriever Type=Basic sparse, Augmentation=None2025.06 | 0.272 | 0.947 | |
| Exp4FuseRetriever Type=Basic sparse, Base Retriever=BM252025.06 | 0.207 | 0.913 | |
| BM25Retriever Type=Basic sparse, Augmentation=None2025.06 | 0.184 | 0.857 |