Information Retrieval on SciFact BEIR (test)
76.6nDCG@10monoT5-3B + BM25
Evaluation Results
| Method | Links | |
|---|---|---|
| monoT5-3B + BM252025.06 | 76.6 | |
| LATTICECorpus size=5K2025.10 | 75.8 | |
| RepLLaMA + RankLLaMA-13B2025.06 | 75 | |
| BGE-largeCorpus size=5K2025.10 | 74.6 | |
| BGE-rer.Corpus size=5K2025.10 | 74.1 | |
| Exp4FuseBase Retriever=SPLADE++-v12025.06 | 73.8 | |
| +mono-T5 (100)Pipeline Configuration=Fixed-k, IPQ=99.72026.04 | 72 | |
| PSI-Rank_{Avg}Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=20.02026.04 | 72 | |
| PSI-Rank_{Dyn}Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=13.02026.04 | 71.6 | |
| Exp4FuseBase Retriever=docT5query2025.06 | 71.3 | |
| ReAttProtocol=Additional training2022.12 | 71.2 | |
| Greedy-k (β = 2)Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=42.92026.04 | 71.1 | |
| ReAttProtocol=Zero-shot performance2022.12 | 71 | |
| SPLADE++-v12025.06 | 70.4 | |
| SPLADE++model=splade-cocondenser-ensembledistil, parameters=110 M, k1=1.2, b=0.752026.05 | 70.24 | |
| Contriever + HyDE2025.06 | 69.1 | |
| TSDAE+GPLProtocol=Additional training2022.12 | 68.9 | |
| Exp4FuseBase Retriever=BM252025.06 | 68.8 | |
| uniCOIL2025.06 | 68.6 | |
| AgentIR BM252026.05 | 68.28 | |
| BM252025.06 | 67.9 | |
| ContrieverProtocol=Additional training2022.12 | 67.7 | |
| docT5query2025.06 | 67.5 | |
| BM25 (100)Pipeline Configuration=Fixed-k, IPQ=99.72026.04 | 67.2 | |
| BM25Protocol=Zero-shot performance2022.12 | 66.5 | |
| ColBERT-NQProtocol=Zero-shot performance2022.12 | 65.3 | |
| PSI-Rank_{Dyn}Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=11.52026.04 | 65.1 | |
| TAS-B2025.06 | 64.4 | |
| PSI-Rank_{Avg,Avg}Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=20.02026.04 | 62.8 | |
| SimLM2025.06 | 62.4 | |
| SimLM + query2doc2025.06 | 59.5 | |
| +mono-T5 (100) + duo-T5 (50)Pipeline Configuration=Fixed-k, IPQ=50.02026.04 | 57.9 | |
| Greedy-k (β = 2)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=43.32026.04 | 57.5 | |
| SimCSEProtocol=Additional training2022.12 | 55 | |
| ANCEProtocol=Zero-shot performance2022.12 | 50.7 | |
| DPRProtocol=Zero-shot performance2022.12 | 31.8 |