Re-ranking on MS MARCO TREC DL In-domain (DL19/DL20)
45MSMColBERTv2
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ColBERTv2Backbone=BERT-base (~110M)2026.02 | 45 | 74.6 | 73.4 | 64.3 | |
| BaselineBackbone=MiniLM2026.02 | 44.7 | 73.8 | 72.9 | 63.8 | |
| Mask 3-ℓ4Backbone=MiniLM2026.02 | 43.9 | 73 | 70.9 | 62.6 | |
| MICE-ℓ4+allBackbone=MiniLM, Interaction layers configuration=all interaction layers starting from layer 42026.02 | 43.1 | 73.4 | 70.1 | 62.2 | |
| BaselineBackbone=Ettin-32M2026.02 | 42.8 | 70.5 | 69.3 | 60.9 | |
| MICE-ℓ6+allBackbone=Ettin-32M, Interaction layers configuration=all interaction layers starting from layer 62026.02 | 42.4 | 70.3 | 69.5 | 60.7 | |
| MICE-ℓ4+3Backbone=MiniLM, Interaction layers configuration=3 interaction layers starting from layer 42026.02 | 42.1 | 72.6 | 69.3 | 61.3 | |
| Mask 3-ℓ6Backbone=Ettin-32M2026.02 | 41.9 | 74.4 | 68.6 | 59.9 | |
| MICE-ℓ6+3Backbone=Ettin-32M, Interaction layers configuration=3 interaction layers starting from layer 62026.02 | 41.9 | 69.3 | 68.4 | 59.8 | |
| BaselineBackbone=Ettin-17M2026.02 | 38.6 | 64.9 | 63.6 | 55.7 | |
| MICE-ℓ3+3Backbone=Ettin-17M, Interaction layers configuration=3 interaction layers starting from layer 32026.02 | 38 | 65.7 | 62.4 | 55.4 | |
| Mask 3-ℓ3Backbone=Ettin-17M2026.02 | 37.8 | 66.1 | 62.4 | 55.4 | |
| MICE-ℓ3+allBackbone=Ettin-17M, Interaction layers configuration=all interaction layers starting from layer 32026.02 | 37.7 | 66.1 | 62.2 | 55.3 | |
| ColBERTv2Backbone=MiniLM2026.02 | 37.3 | 67.8 | 66.3 | 57.2 | |
| BM252026.02 | 23 | 51.2 | 47.7 | 42.5 |