Information Retrieval on TREC DL'19
77nDCG@10RSD
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| RSDFusion Method=CSUM2026.01 | 77 | 52.3 | 0.38 | — | — | — | — | |
| QV-NQCFusion Method=CSUM2026.01 | 76.4 | 52 | 0.323 | — | — | — | — | |
| SMVFusion Method=CSUM2026.01 | 75.9 | 51.3 | 0.341 | — | — | — | — | |
| CSUMWeighting=Unweighted (Baseline)2026.01 | 75.8 | 50 | — | — | — | — | — | |
| DMFusion Method=CSUM2026.01 | 75.8 | 51.4 | 0.181 | — | — | — | — | |
| sigma_maxFusion Method=CSUM2026.01 | 75.7 | 50.9 | 0.299 | — | — | — | — | |
| QV-NQCFusion Method=RRF2026.01 | 75.7 | 50.3 | 0.323 | — | — | — | — | |
| RSDFusion Method=RRF2026.01 | 75.5 | 50.9 | 0.38 | — | — | — | — | |
| BERT-QPPFusion Method=CSUM2026.01 | 75.4 | 49.8 | 0.19 | — | — | — | — | |
| n(sigma_x%)Fusion Method=CSUM2026.01 | 75.2 | 50.5 | 0.302 | — | — | — | — | |
| NQCFusion Method=RRF2026.01 | 75.2 | 50.3 | 0.386 | — | — | — | — | |
| UEFFusion Method=RRF2026.01 | 75.2 | 49.9 | 0.371 | — | — | — | — | |
| SCNQCFusion Method=RRF2026.01 | 75.2 | 50.3 | 0.385 | — | — | — | — | |
| NQA-QPPFusion Method=CSUM2026.01 | 75.2 | 50.7 | 0.149 | — | — | — | — | |
| NQCFusion Method=CSUM2026.01 | 75.1 | 51.7 | 0.386 | — | — | — | — | |
| UEFFusion Method=CSUM2026.01 | 75.1 | 51.6 | 0.371 | — | — | — | — | |
| SCNQCFusion Method=CSUM2026.01 | 75.1 | 51.7 | 0.385 | — | — | — | — | |
| DMFusion Method=RRF2026.01 | 75 | 50.9 | 0.181 | — | — | — | — | |
| QPP-PRPFusion Method=CSUM2026.01 | 74.5 | 49.2 | 0.164 | — | — | — | — | |
| ColBERTv2-e2eRemain=-2026.03 | 74.5 | — | — | — | — | — | — | |
| sigma_maxFusion Method=RRF2026.01 | 74.4 | 49.1 | 0.299 | — | — | — | — | |
| ColBERTv2-rerankRemain=-2026.03 | 74.4 | — | — | — | — | — | — | |
| n(sigma_x%)Fusion Method=RRF2026.01 | 74.2 | 49.5 | 0.302 | — | — | — | — | |
| L(s^(sim)) + LP-Pruning (α = 0.1)Remain=52%2026.03 | 74.2 | — | — | — | — | — | — | |
| BERT-QPPFusion Method=RRF2026.01 | 74.1 | 50.4 | 0.19 | — | — | — | — | |
| WIGFusion Method=CSUM2026.01 | 73.9 | 49.3 | 0.223 | — | — | — | — | |
| NQA-QPPFusion Method=RRF2026.01 | 73.9 | 49.2 | 0.149 | — | — | — | — | |
| L(s^(sim)) + LP-Pruning (α = 0.8)Remain=32%2026.03 | 73.8 | — | — | — | — | — | — | |
| RRFWeighting=Unweighted (Baseline)2026.01 | 73.7 | 48.8 | — | — | — | — | — | |
| L(s^(im)) + VP (Ours)Remain=32%2026.03 | 73.7 | — | — | — | — | — | — | |
| L(s^(L1)) + Norm-Pruning (α = 0.01)Remain=31%2026.03 | 73.6 | — | — | — | — | — | — | |
| SMVFusion Method=RRF2026.01 | 73.5 | 49.5 | 0.341 | — | — | — | — | |
| ConstBERTRemain=47%2026.03 | 73.1 | — | — | — | — | — | — | |
| First pRemain=50%2026.03 | 72.3 | — | — | — | — | — | — | |
| WIGFusion Method=RRF2026.01 | 72.2 | 47.7 | 0.223 | — | — | — | — | |
| Voronoi Pruning (Ours)Remain=50%2026.03 | 72.2 | — | — | — | — | — | — | |
| QPP-PRPFusion Method=RRF2026.01 | 72 | 47.1 | 0.164 | — | — | — | — | |
| Att. ScoreRemain=50%2026.03 | 72 | — | — | — | — | — | — | |
| StopwordsRemain=67%2026.03 | 70.9 | — | — | — | — | — | — | |
| SPLADEv2Remain=-2026.03 | 70.6 | — | — | — | — | — | — | |
| IDFRemain=50%2026.03 | 70.2 | — | — | — | — | — | — | |
| SFT+DPORetriever=BM25, Distillation=DeepSeek Distillation2026.03 | 65.36 | — | — | 44.21 | 82.11 | — | — | |
| SFT-onlyRetriever=BM25, Distillation=DeepSeek Distillation2026.03 | 64.05 | — | — | 42.69 | 81.32 | — | — | |
| DPO-onlyRetriever=BM25, Distillation=DeepSeek Distillation2026.03 | 62.92 | — | — | 43.34 | 82.04 | — | — | |
| Query2DocRetriever=BM25, Distillation=DeepSeek Distillation2026.03 | 62.36 | — | — | 41.77 | 79.71 | — | — | |
| Original model expansionRetriever=BM25, Distillation=DeepSeek Distillation2026.03 | 61.64 | — | — | 41.5 | 75.92 | — | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=Learn2026.02 | 60.43 | — | — | — | — | — | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=DNorm2026.02 | 59.95 | — | — | — | — | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=QNorm2026.02 | 58.02 | — | — | — | — | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=Learn2026.02 | 57.76 | — | — | — | — | — | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=QNorm2026.02 | 57.51 | — | — | — | — | — | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=Dot2026.02 | 56.82 | — | — | — | — | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=Dot2026.02 | 56.69 | — | — | — | — | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=Cosine2026.02 | 56.65 | — | — | — | — | — | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=Cosine2026.02 | 56.11 | — | — | — | — | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=DNorm2026.02 | 55.41 | — | — | — | — | — | — | |
| BM25+RocchioRetriever=BM25, Distillation=DeepSeek Distillation2026.03 | 52.75 | — | — | 34.74 | 66.76 | — | — | |
| BM25Remain=-2026.03 | 50.6 | — | — | — | — | — | — | |
| BM25Retriever=BM25, Distillation=DeepSeek Distillation2026.03 | 50.58 | — | — | 30.13 | 70.36 | — | — | |
| ContrieverBackbone=Contriever, Similarity Function=PT2026.02 | 42.85 | — | — | — | — | — | — | |
| RetroMAEBackbone=RetroMAE, Similarity Function=PT2026.02 | 14.05 | — | — | — | — | — | — | |
| BM25»MonoT5c=502026.05 | — | — | — | — | — | 54.1 | 38.9 | |
| BM25»MonoT5c=1002026.05 | — | — | — | — | — | 56.3 | 48.8 | |
| BM25»MonoT5 w/ RM3c=502026.05 | — | — | — | — | — | 55.7 | 40.5 | |
| BM25»MonoT5 w/ RM3c=1002026.05 | — | — | — | — | — | 57.2 | 50.7 | |
| GenQRc=502026.05 | — | — | — | — | — | 55.3 | 40.1 | |
| GenQRc=1002026.05 | — | — | — | — | — | 57.4 | 51 | |
| GenQR + ReformIRc=502026.05 | — | — | — | — | — | 60 | 45.3 | |
| GenQR + ReformIRc=1002026.05 | — | — | — | — | — | 61.7 | 56.1 | |
| GenQR + RRFc=502026.05 | — | — | — | — | — | 54.7 | 39.4 | |
| GenQR + RRFc=1002026.05 | — | — | — | — | — | 56.9 | 50.5 | |
| GEnsc=502026.05 | — | — | — | — | — | 56.3 | 42.3 | |
| GEnsc=1002026.05 | — | — | — | — | — | 58.7 | 53.7 | |
| GEns + PRFc=502026.05 | — | — | — | — | — | 54.7 | 41.2 | |
| GEns + PRFc=1002026.05 | — | — | — | — | — | 56.4 | 50.8 | |
| GEns + PRF + ReformIRc=502026.05 | — | — | — | — | — | 59.2 | 45.4 | |
| GEns + PRF + ReformIRc=1002026.05 | — | — | — | — | — | 62.6 | 57.5 | |
| GEns + ReformIRc=502026.05 | — | — | — | — | — | 62.2 | 48.7 | |
| GEns + ReformIRc=1002026.05 | — | — | — | — | — | 63.4 | 58.4 | |
| GEns + RRFc=502026.05 | — | — | — | — | — | 54.8 | 42.1 | |
| GEns + RRFc=1002026.05 | — | — | — | — | — | 57.5 | 52.5 | |
| MonoT5c=502026.05 | — | — | — | — | — | 62.5 | 51.2 | |
| MonoT5c=1002026.05 | — | — | — | — | — | 61.1 | 59.9 | |
| QA-Expandc=502026.05 | — | — | — | — | — | 61.3 | 46.8 | |
| QA-Expandc=1002026.05 | — | — | — | — | — | 63.3 | 57.5 | |
| QA-Expand + ReformIRc=502026.05 | — | — | — | — | — | 67.2 | 52.6 | |
| QA-Expand + ReformIRc=1002026.05 | — | — | — | — | — | 66.8 | 62.9 | |
| QA-Expand + RRFc=502026.05 | — | — | — | — | — | 61.6 | 46.4 | |
| QA-Expand + RRFc=1002026.05 | — | — | — | — | — | 62.6 | 58.2 | |
| Query2Docc=502026.05 | — | — | — | — | — | 62.7 | 50.2 | |
| Query2Docc=1002026.05 | — | — | — | — | — | 63 | 60.5 | |
| Query2Doc + ReformIRc=502026.05 | — | — | — | — | — | 67.1 | 53.8 | |
| Query2Doc + ReformIRc=1002026.05 | — | — | — | — | — | 67.3 | 63.9 |