Nugget-based retrieval on CRUX Multi-News
38Precision@10CoveR (pFT on MS)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| CoveR (pFT on MS)Backbone=ModernBERT-base, Size=149M, Pre-finetuning=MSMARCO2026.05 | 38 | 55.6 | 58.4 | 59 | |
| Qwen3-EmbedSize=8B2026.05 | 37.4 | 55.3 | 59.7 | 60.9 | |
| CoveR (w/o pFT)Backbone=ModernBERT-base, Size=149M, Pre-finetuning=None2026.05 | 36.8 | 54.3 | 56.2 | 57.4 | |
| Unsupervised (Unsup.)Backbone=ModernBERT-base, Size=149M2026.05 | 36.4 | 51.8 | 50.5 | 53.5 | |
| CoveR (pFT on SCOPE-flt)Backbone=ModernBERT-base, Size=149M, Pre-finetuning=SCOPE-flt2026.05 | 36 | 53.1 | 55.2 | 56.6 | |
| Nomic-EmbedSize=149M2026.05 | 35.4 | 51.4 | 52.6 | 55.2 | |
| Qwen3-EmbedSize=0.6B2026.05 | 35 | 52.4 | 56.8 | 57 | |
| SPLADE-v3Size=110M2026.05 | 34.2 | 50.7 | 51.7 | 53.6 | |
| Relevance (Rel.)Backbone=ModernBERT-base, Size=149M2026.05 | 33.9 | 48.7 | 49.5 | 51.8 | |
| MMR (λ = .99)Backbone=ModernBERT-base, Size=149M2026.05 | 33.6 | 48.5 | 49.3 | 51.6 | |
| + MultiQ (SimSum)Backbone=ModernBERT-base, Size=149M2026.05 | 31 | 42.6 | 43.4 | 49.3 | |
| + MultiQ (RRF)Backbone=ModernBERT-base, Size=149M2026.05 | 30.8 | 44 | 45.5 | 49.6 | |
| + MultiQ (RRB)Backbone=ModernBERT-base, Size=149M2026.05 | 28.2 | 41.4 | 44.4 | 48.5 | |
| BM25Size=-2026.05 | 26.1 | 41.2 | 44.2 | 46.2 |