List your company
ResearchFormerly WizWand

Information Retrieval on SciFact BEIR (test)

76.6nDCG@10monoT5-3B + BM25
30.00842.10454.266.296Dec 5, 2022Jul 4, 2023Jan 31, 2024Aug 29, 2024Mar 28, 2025Oct 25, 2025May 24, 2026
Updated 5mo ago

Evaluation results

MethodLinks
monoT5-3B + BM252025.0676.6
LATTICECorpus size=5K2025.1075.8
RepLLaMA + RankLLaMA-13B2025.0675
BGE-largeCorpus size=5K2025.1074.6
BGE-rer.Corpus size=5K2025.1074.1
Exp4FuseBase Retriever=SPLADE++-v12025.0673.8
+mono-T5 (100)Pipeline Configuration=Fixed-k, IPQ=99.72026.0472
PSI-Rank_{Avg}Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=20.02026.0472
PSI-Rank_{Dyn}Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=13.02026.0471.6
Exp4FuseBase Retriever=docT5query2025.0671.3
ReAttProtocol=Additional training2022.1271.2
Greedy-k (β = 2)Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=42.92026.0471.1
ReAttProtocol=Zero-shot performance2022.1271
SPLADE++-v12025.0670.4
SPLADE++model=splade-cocondenser-ensembledistil, parameters=110 M, k1=1.2, b=0.752026.0570.24
Contriever + HyDE2025.0669.1
TSDAE+GPLProtocol=Additional training2022.1268.9
Exp4FuseBase Retriever=BM252025.0668.8
uniCOIL2025.0668.6
AgentIR BM252026.0568.28
BM252025.0667.9
ContrieverProtocol=Additional training2022.1267.7
docT5query2025.0667.5
BM25 (100)Pipeline Configuration=Fixed-k, IPQ=99.72026.0467.2
BM25Protocol=Zero-shot performance2022.1266.5
ColBERT-NQProtocol=Zero-shot performance2022.1265.3
PSI-Rank_{Dyn}Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=11.52026.0465.1
TAS-B2025.0664.4
PSI-Rank_{Avg,Avg}Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=20.02026.0462.8
SimLM2025.0662.4
SimLM + query2doc2025.0659.5
+mono-T5 (100) + duo-T5 (50)Pipeline Configuration=Fixed-k, IPQ=50.02026.0457.9
Greedy-k (β = 2)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=43.32026.0457.5
SimCSEProtocol=Additional training2022.1255
ANCEProtocol=Zero-shot performance2022.1250.7
DPRProtocol=Zero-shot performance2022.1231.8