Information Retrieval on TREC DL20
75.6NDCG@10ColBERTv2-rerank
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ColBERTv2-rerankRemain=-2026.03 | 75.6 | — | — | — | — | — | |
| L(s^(sim)) + LP-Pruning (α = 0.1)Remain=52%2026.03 | 73.8 | — | — | — | — | — | |
| ConstBERTRemain=47%2026.03 | 73.3 | — | — | — | — | — | |
| L(s^(sim)) + LP-Pruning (α = 0.8)Remain=32%2026.03 | 73.3 | — | — | — | — | — | |
| Voronoi Pruning (Ours)Remain=50%2026.03 | 73.1 | — | — | — | — | — | |
| L(s^(im)) + VP (Ours)Remain=32%2026.03 | 73 | — | — | — | — | — | |
| L(s^(L1)) + Norm-Pruning (α = 0.01)Remain=31%2026.03 | 72.1 | — | — | — | — | — | |
| SPLADEv2Remain=-2026.03 | 68.7 | — | — | — | — | — | |
| StopwordsRemain=67%2026.03 | 67.8 | — | — | — | — | — | |
| DPRMethod Type=Supervised Fine-Tuned Dense retriever2025.06 | 65.3 | — | — | 41.8 | 81.4 | — | |
| ThinkQEEvaluation Protocol=Zero-shot Query expansion with BM25, Backbone Model=R1-14B2025.06 | 64.7 | — | — | 43.9 | 87.8 | — | |
| ANCEMethod Type=Supervised Fine-Tuned Dense retriever2025.06 | 64.6 | — | — | 40.8 | 77.6 | — | |
| Rank-K-32BMethod Type=R1-Distilled Reranker, Evaluation Protocol=BM25 Top-20 Docs2025.06 | 64.3 | — | — | — | — | — | |
| ThinkQEEvaluation Protocol=Zero-shot Query expansion with BM25, Backbone Model=Phi4-Reasoning-14B2025.06 | 63.9 | — | — | 43 | 87.2 | — | |
| ThinkQEEvaluation Protocol=Zero-shot Query expansion with BM25, Backbone Model=QWEN3-14B2025.06 | 63.5 | — | — | 42.4 | 88.4 | — | |
| ThinkQEEvaluation Protocol=Zero-shot Query expansion with BM25, Backbone Model=OpenThinker2-7B2025.06 | 63.5 | — | — | 43.2 | 87.9 | — | |
| ContrieverFTMethod Type=Supervised Fine-Tuned Dense retriever2025.06 | 63.2 | — | — | 43.6 | 85.8 | — | |
| Query2docMethod Type=Zero-shot Query expansion, Evaluation Protocol=with BM252025.06 | 62.9 | — | — | — | — | — | |
| Two-LLM QE (Refine)fusion_method=Refinement, model_count=22026.02 | 62.86 | 68.33 | 58.51 | — | — | — | |
| ThinkQEEvaluation Protocol=Zero-shot Query expansion with BM25, Backbone Model=QWEN3-8B2025.06 | 62.8 | — | — | 41.9 | 88 | — | |
| MILLMethod Type=Zero-shot Query expansion, Evaluation Protocol=with BM252025.06 | 61.8 | — | — | — | 85.3 | — | |
| Rank1-32BMethod Type=R1-Distilled Reranker, Evaluation Protocol=BM25 Top-20 Docs2025.06 | 61.2 | — | — | — | — | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=Learn2026.02 | 59.69 | — | — | — | — | — | |
| Two-LLM QE (Concat)fusion_method=Concatenation, model_count=22026.02 | 59.47 | 64.81 | 58.22 | — | — | — | |
| SFT+DPORetriever=BM25 (DeepSeek Distillation)2026.03 | 59.21 | — | — | 38.31 | — | 72.03 | |
| RetroMAEBackbone=RetroMAE, Similarity Function=DNorm2026.02 | 59.2 | — | — | — | — | — | |
| Cluster-ICL QEexemplar_selection=Cluster-based, prompting=Few-Shot2026.02 | 58.71 | 63.7 | 56.68 | — | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=Learn2026.02 | 58.48 | — | — | — | — | — | |
| DPO-onlyRetriever=BM25 (DeepSeek Distillation)2026.03 | 58.46 | — | — | 37.45 | — | 72.08 | |
| RetroMAEBackbone=RetroMAE, Similarity Function=QNorm2026.02 | 58.11 | — | — | — | — | — | |
| Query2DocRetriever=BM25 (DeepSeek Distillation)2026.03 | 58.01 | — | — | 36.33 | — | 71.2 | |
| SFT-onlyRetriever=BM25 (DeepSeek Distillation)2026.03 | 57.97 | — | — | 36.64 | — | 72.58 | |
| HyDEMethod Type=Zero-shot Query expansion, Evaluation Protocol=with BM252025.06 | 57.9 | — | — | 38.2 | 84.4 | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=Dot2026.02 | 57.83 | — | — | — | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=Cosine2026.02 | 57.25 | — | — | — | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=DNorm2026.02 | 57.17 | — | — | — | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=QNorm2026.02 | 56.87 | — | — | — | — | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=Cosine2026.02 | 56.85 | — | — | — | — | — | |
| FewShot4-Fixedprompting=Few-Shot, shots=4, exemplar_selection=Fixed2026.02 | 56.38 | 64.44 | 55.72 | — | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=Dot2026.02 | 56.32 | — | — | — | — | — | |
| Original model expansionRetriever=BM25 (DeepSeek Distillation)2026.03 | 54.76 | — | — | 33.79 | — | 67.66 | |
| ZeroShotprompting=Zero-Shot2026.02 | 53.49 | 59.44 | 51 | — | — | — | |
| BM25+Rocchioretriever=Lexical, expansion=Rocchio2026.02 | 49.1 | 57.22 | 52.34 | — | — | — | |
| BM25+RocchioRetriever=BM25 (DeepSeek Distillation)2026.03 | 49.1 | — | — | 31.15 | — | 65.13 | |
| BM25Method Type=Keyword Retrieval2025.06 | 48 | — | — | 28.6 | 78.6 | — | |
| BM25retriever=Lexical, expansion=None2026.02 | 47.96 | 53.89 | 48.34 | — | — | — | |
| BM25Retriever=BM25 (DeepSeek Distillation)2026.03 | 47.96 | — | — | 28.56 | — | 65.85 | |
| BM25Remain=-2026.03 | 47.5 | — | — | — | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=PT2026.02 | 40.52 | — | — | — | — | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=PT2026.02 | 9 | — | — | — | — | — |