Information Retrieval on MS MARCO (MRR@10, NDCG@10, Rec@1000)
93NDCG@10IMRNNs
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| IMRNNsBackbone=MiniLM2026.01 | 93 | 92 | 99 | |
| IMRNNsBackbone=BGE2026.01 | 93 | 91 | 99 | |
| text-embedding-ada-002Dim.=1,536, Type=Dense2025.05 | 92.18 | — | — | |
| MiniLM2026.01 | 91 | 90 | 97 | |
| AngIEDim.=1,024, Type=Dense2025.05 | 90.43 | — | — | |
| SBERTnewDim.=768, Type=Dense2025.05 | 88.74 | — | — | |
| BGE2026.01 | 88 | 89 | 97 | |
| IMRNNsBackbone=e5-large-v22026.01 | 88 | 85 | 99 | |
| ModernBERTembDim.=1,024, Type=Dense2025.05 | 87.39 | — | — | |
| e5-large-v22026.01 | 85 | 81 | 97 | |
| DIMEPruning Ratio=20%2026.01 | 85 | 81 | 97 | |
| DIMEPruning Ratio=40%2026.01 | 84 | 80 | 97 | |
| SearchAd2026.01 | 84 | 80 | 96 | |
| LDIREncoder=AngIE, Dim.=200, Type=Dense2025.05 | 83.11 | — | — | |
| DIMEPruning Ratio=60%2026.01 | 83 | 79 | 96 | |
| LDIREncoder=SBERTnew, Dim.=500, Type=Dense2025.05 | 82.01 | — | — | |
| LDIREncoder=AngIE, Dim.=500, Type=Dense2025.05 | 82 | — | — | |
| DIMEPruning Ratio=80%2026.01 | 80 | 75 | 93 | |
| LDIREncoder=SBERTnew, Dim.=200, Type=Dense2025.05 | 78.24 | — | — | |
| HYPENCODERLayers=62026.01 | 71 | 71 | 75 | |
| HYPENCODERLayers=82026.01 | 70 | 72 | 75 | |
| HYPENCODERLayers=42026.01 | 69 | 70 | 74 | |
| BM25Dim.=N/A, Type=Sparse2025.05 | 68.42 | — | — | |
| HYPENCODERLayers=22026.01 | 68 | 71 | 74 | |
| LDIREncoder=ModernBERTemb, Dim.=500, Type=Dense2025.05 | 64.75 | — | — | |
| LLM2VecDim.=4,096, Type=Dense2025.05 | 63.48 | — | — | |
| CQG-MBQADim.=9,614, Type=0/1 Emb.2025.05 | 62.21 | — | — | |
| LDIREncoder=ModernBERTemb, Dim.=200, Type=Dense2025.05 | 57.65 | — | — | |
| SimCSEsupDim.=768, Type=Dense2025.05 | 47.86 | — | — | |
| SimCSEunsupDim.=768, Type=Dense2025.05 | 44.63 | — | — | |
| GloVeDim.=300, Type=Dense2025.05 | 44.27 | — | — | |
| ContrieverAdaptation setting=additional training2022.12 | 40.7 | — | — | |
| QAEmb-MBQADim.=10,654, Type=0/1 Emb.2025.05 | 40.51 | — | — | |
| ColBERTAdaptation setting=additional training2022.12 | 40.1 | — | — | |
| ReAttAdaptation setting=additional training (supervised adaptation)2022.12 | 39.9 | — | — | |
| ANCEAdaptation setting=additional training2022.12 | 38.8 | — | — | |
| TeacherLatency (ms)=17.152, Embedding Dimension=7682022.05 | 38.77 | 33.02 | 95.84 | |
| ConAELatency (ms)=7.158, Embedding Dimension=2562022.05 | 38.64 | 32.94 | 95.6 | |
| ConAELatency (ms)=3.942, Embedding Dimension=1282022.05 | 38.16 | 32.45 | 95.23 | |
| ANCELatency (ms)=6.159, Embedding Dimension=2562022.05 | 37.09 | 31.45 | 95.45 | |
| ANCELatency (ms)=3.419, Embedding Dimension=1282022.05 | 36.67 | 30.92 | 95.27 | |
| CELatency (ms)=7.344, Embedding Dimension=2562022.05 | 34.72 | 29.59 | 93.33 | |
| CELatency (ms)=4.53, Embedding Dimension=1282022.05 | 34.38 | 29.17 | 93.45 | |
| docT5queryAdaptation setting=additional training2022.12 | 33.8 | — | — | |
| ConAELatency (ms)=3.087, Embedding Dimension=642022.05 | 33.76 | 28.62 | 92.22 | |
| ANCELatency (ms)=3.041, Embedding Dimension=642022.05 | 32.95 | 27.73 | 92.17 | |
| ColBERT-NQAdaptation setting=zero-shot2022.12 | 32.8 | — | — | |
| ReAttAdaptation setting=zero-shot2022.12 | 32.3 | — | — | |
| CELatency (ms)=3.046, Embedding Dimension=642022.05 | 30.36 | 25.51 | 90.42 | |
| Bag-of-WordsVocabulary=BERT, Dim.=28,996, Type=Sparse2025.05 | 29.79 | — | — | |
| PCALatency (ms)=6.296, Embedding Dimension=2562022.05 | 29.4 | 24.4 | 92.57 | |
| PCALatency (ms)=3.525, Embedding Dimension=1282022.05 | 28.38 | 23.48 | 91.7 | |
| BM25Adaptation setting=zero-shot2022.12 | 22.8 | — | — | |
| PCALatency (ms)=2.627, Embedding Dimension=642022.05 | 22.59 | 18.55 | 85.4 | |
| DPRAdaptation setting=zero-shot2022.12 | 17.7 | — | — | |
| BERTbaseDim.=768, Type=Dense2025.05 | 16.86 | — | — | |
| BERT (dense)2026.04 | — | 32.9 | 93.3 | |
| BERT (Splade)Teachers=12026.04 | — | 37.5 | 98.2 | |
| BERT (Splade) + further MLMTeachers=12026.04 | — | 37.7 | 98.1 | |
| BM252026.04 | — | 18.4 | 85.3 | |
| Co-EnsembleDistilTeachers=12026.04 | — | 38.3 | 98.3 | |
| Co-SelfDistilTeachers=12026.04 | — | 37.5 | 98.5 | |
| CoCondenser2026.04 | — | 38.2 | 98.4 | |
| ColBERTv22026.04 | — | 39.7 | 98.5 | |
| DeeperImpact2026.04 | — | 37.3 | 96.8 | |
| DeepImpact2026.04 | — | 32.7 | 94.8 | |
| DPR2026.04 | — | 31.9 | 94.1 | |
| ESPLADETeachers=12026.04 | — | 38.1 | 98.3 | |
| ModernBERT (dense)2026.04 | — | 32.9 | 94.8 | |
| ModernBERT (Splade)Teachers=12026.04 | — | 35.7 | 98 | |
| ModernBERT (Splade) + further MLMTeachers=12026.04 | — | 35.4 | 97.8 | |
| ModernBERT (Splade) + lowercase inputTeachers=12026.04 | — | 36.3 | 97.9 | |
| ModernBERT-VTTeachers=12026.04 | — | 38.3 | 98.4 | |
| SPLADE-v3FLOPS=1.22024.03 | — | 40.2 | — | |
| SPLADE-v3Teachers=52026.04 | — | 40 | 98.7 | |
| SPLADE-v3-DistilBERTFLOPS=1.42024.03 | — | 38.7 | — | |
| SPLADE-v3-DocFLOPS=1.42024.03 | — | 37.8 | — | |
| SPLADE-v3-LexicalFLOPS=0.62024.03 | — | 40 | — | |
| SPLADE++SDFLOPS=1.42024.03 | — | 37.6 | — | |
| uniCOIL2026.04 | — | 35.1 | — |