Retrieval on 2WikiMQA (test)
69.7Recall@KSelfAsk
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| SelfAskK=27.42025.03 | 69.7 | — | — | — | — | — | — | — | — | — | |
| IRCoTK=11.12025.03 | 66.5 | — | — | — | — | — | — | — | — | — | |
| IterRetGenK=6.02025.03 | 48.7 | — | — | — | — | — | — | — | — | — | |
| L-RAGK=8.02025.03 | 48 | — | — | — | — | — | — | — | — | — | |
| L-RAGK=4.02025.03 | 38.9 | — | — | — | — | — | — | — | — | — | |
| Vanilla RAGK=8.02025.03 | 7.4 | — | — | — | — | — | — | — | — | — | |
| HyDEK=6.02025.03 | 7.1 | — | — | — | — | — | — | — | — | — | |
| Vanilla RAGK=4.02025.03 | 6.1 | — | — | — | — | — | — | — | — | — | |
| BM252025.05 | — | — | — | — | — | — | — | 41 | 68 | 51.2 | |
| Contriever2025.05 | — | — | — | — | — | — | — | 20.5 | 33 | 25.3 | |
| InstructRAG2025.05 | — | — | — | — | — | — | — | 19.7 | 40.7 | 26.5 | |
| IRCoT2025.05 | — | — | — | — | — | — | — | 53.8 | 68.9 | 60.4 | |
| PROMPTRANKICL=false, Backbone=T5-XL, Instruction=best instruction, Temperature Scaling=true2022.05 | — | 19.3 | 58.6 | 62.7 | 33.9 | 60 | 64.2 | — | — | — | |
| Q-DREAMDynamic Passage Retrieval Module=Disabled2025.05 | — | — | — | — | — | — | — | 57.4 | 62 | 59.6 | |
| Q-DREAMDynamic Passage Retrieval Module=Enabled2025.05 | — | — | — | — | — | — | — | 81.8 | 85.7 | 83.7 | |
| TF-IDFLearning Protocol=Unsupervised2022.05 | — | 5.8 | 8.9 | 23.8 | 22.2 | 37.8 | 44.2 | — | — | — | |
| TF-IDF+BM25Learning Protocol=Unsupervised2022.05 | — | 7.6 | 34.1 | 45.8 | 20.7 | 44.9 | 53 | — | — | — |