Information Retrieval on DBPedia BEIR (test)
48.2nDCG@10RepLLaMA + RankLLaMA-13B
Evaluation results
| Method | Links | |
|---|---|---|
| RepLLaMA + RankLLaMA-13B2025.06 | 48.2 | |
| Exp4FuseBase Retriever=SPLADE++-v12025.06 | 47.2 | |
| monoT5-3B + BM252025.06 | 44.5 | |
| SPLADE++-v12025.06 | 43.7 | |
| SafeZero-shot=true, Corpus Size=4.6M2026.02 | 43.7 | |
| SPZero-shot=true, Corpus Size=4.6M2026.02 | 43.6 | |
| BMPZero-shot=true, Corpus Size=4.6M2026.02 | 43.3 | |
| SeismicWaveZero-shot=true, Corpus Size=4.6M2026.02 | 43.2 | |
| LSP/0Zero-shot=true, Corpus Size=4.6M2026.02 | 42.9 | |
| PSI-Rank_{Avg,Dyn}Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=13.52026.04 | 42.3 | |
| PSI-Rank_{Avg}Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=20.02026.04 | 41.9 | |
| +mono-T5 (100)Pipeline Configuration=Fixed-k, IPQ=99.82026.04 | 40.7 | |
| Exp4FuseBase Retriever=docT5query2025.06 | 38.9 | |
| TAS-B2025.06 | 38.4 | |
| SimLM + query2doc2025.06 | 38.3 | |
| Contriever + HyDE2025.06 | 36.8 | |
| Exp4FuseBase Retriever=BM252025.06 | 36.1 | |
| SimLM2025.06 | 34.9 | |
| uniCOIL2025.06 | 33.8 | |
| docT5query2025.06 | 33.1 | |
| BM252025.06 | 31.8 |