Information Retrieval on MS MARCO small (dev)
41.1MRR@10SimLM
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SimLMEncoder=BERTbase2026.04 | 41.1 | — | — | — | |
| ColBERTv2Encoder=BERTbase2026.04 | 39.7 | — | — | — | |
| SPLADEv3Encoder=DistilBERT2026.04 | 38.7 | 1.4 | 165 | 19.1 | |
| ColBERTv2Encoder=DistilBERT2026.04 | 38.3 | — | — | — | |
| SAE-SPLADEEncoder=DistilBERT, k=162026.04 | 38.2 | 1.37 | 191 | 18.7 | |
| SPLADEEncoder=DistilBERT2026.04 | 37.7 | 1.47 | 118 | 18.1 | |
| SAE-SPLADEEncoder=DistilBERT, k=82026.04 | 37.6 | 0.67 | 109 | 18.8 | |
| SAE-SPLADEEncoder=DistilBERT, k=42026.04 | 37.1 | 0.33 | 66 | 18.6 | |
| CL-SREncoder=BERTbase2026.04 | 36.8 | 0.74 | 65 | 17.9 | |
| BM25Encoder=-2026.04 | 18.3 | 0.13 | 39 | 0 |