Sparse Retrieval on MS MARCO v1 (dev)
51.5nDCG@10ModernBERT-VT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ModernBERT-VT+IDF=true, +ℓ0=true2026.04 | 51.5 | 2.1 | 265.3 | |
| ModernBERT-VT+IDF=true, +ℓ0=false2026.04 | 51.4 | 2.1 | 286.8 | |
| Geng et al.+IDF=true, +ℓ0=false2026.04 | 50.4 | 2.1 | 248.6 | |
| CoCondenser-ℓ0+IDF=true, +ℓ0=true2026.04 | 50.3 | 2.1 | 275 | |
| CoCondenser-IDF+IDF=true, +ℓ0=false2026.04 | 49.5 | 2.4 | 327.2 | |
| ModernBERT (naive) + lowercase input+IDF=true, +ℓ0=true, lowercase input=true2026.04 | 49.5 | 2.1 | 296.9 | |
| Nardini et al.+IDF=true, +ℓ0=false2026.04 | 48.9 | — | — | |
| SPLADE-v3-doc+IDF=false, +ℓ0=false2026.04 | 46.8 | 3.3 | 240.3 | |
| BM25+IDF=false, +ℓ0=false2026.04 | 44.5 | — | — | |
| ModernBERT (naive)+IDF=true, +ℓ0=true2026.04 | 44.4 | 1.7 | 337.4 |