Multilingual Information Retrieval on mMARCO small (dev)
30.1MRR@10 (Spanish)mColBERT
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| mColBERTMetric=MRR@102026.04 | 30.1 | — | — | — | 28.9 | — | 25 | 24.6 | 35.2 | — | |
| SAE-SPLADEk=8, top-k constraint=8, Backbone=multilingual DistilBERT, Metric=MRR@102026.04 | 26.6 | — | — | 18.8 | 25.8 | 23.6 | 22 | 23.1 | 30.7 | 24.4 | |
| SPLADEk=8, top-k constraint=8, Backbone=multilingual DistilBERT, Metric=MRR@102026.04 | 25.6 | — | — | 19.5 | 25.2 | 23.9 | 21.1 | 22.9 | 31.4 | 24.2 | |
| BM25Metric=MRR@102026.04 | 15.8 | — | — | 11.1 | 15.5 | 14.1 | 12.4 | 11.6 | 18.3 | 14.1 | |
| SPLADEk=8, top-k constraint=8, Backbone=multilingual DistilBERT, Metric=QD-FLOPs2026.04 | 2.52 | — | — | 5.22 | 2.68 | 4.14 | 3.87 | 3.11 | 2.14 | 3.38 | |
| SAE-SPLADEk=8, top-k constraint=8, Backbone=multilingual DistilBERT, Metric=QD-FLOPs2026.04 | 1.66 | — | — | 3.94 | 1.88 | 3.2 | 3.02 | 2.09 | 1.63 | 2.49 |