Information Retrieval on MS MARCO (dev)
40MRR@10ColBERTv2-rerank
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ColBERTv2-rerankRemain=-2026.03 | 40 | — | — | |
| L(s^(sim)) + LP-Pruning (α = 0.1)Remain=52%2026.03 | 39.9 | — | — | |
| ColBERTv2-e2eRemain=-2026.03 | 39.7 | — | — | |
| L(s^(sim)) + LP-Pruning (α = 0.8)Remain=32%2026.03 | 39.7 | — | — | |
| L(s^(im)) + VP (Ours)Remain=32%2026.03 | 39.5 | — | — | |
| L(s^(L1)) + Norm-Pruning (α = 0.01)Remain=31%2026.03 | 39.2 | — | — | |
| ConstBERTRemain=47%2026.03 | 39 | — | — | |
| Voronoi Pruning (Ours)Remain=50%2026.03 | 38.9 | — | — | |
| AligneRbaseRemain=40%2026.03 | 38.1 | — | — | |
| First pRemain=50%2026.03 | 37.7 | — | — | |
| Att. ScoreRemain=50%2026.03 | 36 | — | — | |
| SPLADEv2Remain=-2026.03 | 35.8 | — | — | |
| IDFRemain=50%2026.03 | 32.6 | — | — | |
| StopwordsRemain=67%2026.03 | 30.9 | — | — | |
| BM25Remain=-2026.03 | 18.7 | — | — | |
| ColBERTParams=140M2026.03 | — | — | 98 | |
| ContrieverBackbone=Contriever, Similarity Function=PT2026.02 | — | 19.45 | — | |
| ContrieverBackbone=Contriever, Similarity Function=Cosine2026.02 | — | 30.86 | — | |
| ContrieverBackbone=Contriever, Similarity Function=Dot2026.02 | — | 31.07 | — | |
| ContrieverBackbone=Contriever, Similarity Function=QNorm2026.02 | — | 31.35 | — | |
| ContrieverBackbone=Contriever, Similarity Function=DNorm2026.02 | — | 31.4 | — | |
| ContrieverBackbone=Contriever, Similarity Function=Learn2026.02 | — | 32.17 | — | |
| FGR-ColBERTParams=140M2026.03 | — | — | 97.12 | |
| RetroMAEBackbone=RetroMAE, Similarity Function=PT2026.02 | — | 2.87 | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=Cosine2026.02 | — | 30.68 | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=Dot2026.02 | — | 31.24 | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=QNorm2026.02 | — | 32.15 | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=DNorm2026.02 | — | 32.92 | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=Learn2026.02 | — | 32.84 | — |