Information Retrieval on BEIR COVID v1 (test)
63.5nDCG@10PSI-Rank_{Dyn}
Evaluation results
| Method | Links | |
|---|---|---|
| PSI-Rank_{Dyn}Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=43.62026.04 | 63.5 | |
| +mono-T5 (100)Pipeline Configuration=Fixed-k, IPQ=100.02026.04 | 63.1 | |
| +mono-T5 (100) + duo-T5 (50)Pipeline Configuration=Fixed-k, IPQ=50.02026.04 | 63.1 | |
| PSI-Rank_{Avg}Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=100.02026.04 | 63.1 | |
| Choppy (β = 2)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=45.02026.04 | 63 | |
| Greedy-k (β = 2)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=44.02026.04 | 62.9 | |
| AttnCut (β = 2)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=42.02026.04 | 62.8 | |
| Choppy (β = 2)Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=55.02026.04 | 62.7 | |
| BiCut (η = 0.6)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=46.02026.04 | 62.5 | |
| MtCut (β = 2)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=42.02026.04 | 62.5 | |
| Choppy (β = 2, β = 2)Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=38.02026.04 | 62.5 | |
| PSI-Rank_{Dyn,Dyn}Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=14.32026.04 | 62.4 | |
| Greedy-k (β = 2)Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=43.02026.04 | 62.3 | |
| AttnCut (β = 2, β = 2)Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=35.02026.04 | 62.2 | |
| AttnCut (β = 2)Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=36.02026.04 | 62.1 | |
| PSI-Rank_{Avg,Dyn}Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=16.22026.04 | 62.1 | |
| Greedy-k (β = 2, β = 2)Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=36.02026.04 | 62 | |
| BiCut (η = 0.6, η = 0.6)Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=39.02026.04 | 61.8 | |
| MtCut (β = 2, β = 2)Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=35.02026.04 | 61.8 | |
| MtCut (β = 2)Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=36.02026.04 | 61.7 | |
| PSI-Rank_{Avg}Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=20.02026.04 | 61.7 | |
| PSI-Rank_{Avg,Avg}Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=20.02026.04 | 61.7 | |
| PSI-Rank_{Dyn,Avg}Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=12.82026.04 | 61.6 | |
| BiCut (η = 0.6)Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=65.02026.04 | 61.2 | |
| PSI-Rank_{Dyn}Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=17.32026.04 | 61.1 | |
| BM25 (100)Pipeline Configuration=Fixed-k, IPQ=100.02026.04 | 57.6 |