Multi-hop Passage Retrieval on HotpotQA (dev)
94.4Top-5HLP
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HLPfine-tuned=true2022.03 | 94.4 | — | — | 98.5 | 99.5 | |
| WLPfine-tuned=true2022.03 | 89.7 | — | — | 97.3 | 99.2 | |
| BFSfine-tuned=true2022.03 | 87.4 | — | — | 95.8 | 98.7 | |
| ICTfine-tuned=true2022.03 | 84.8 | — | — | 94.4 | 98.3 | |
| No Pre-trainfine-tuned=true2022.03 | 83 | — | — | 94.2 | 97.4 | |
| HLPfine-tuned=true2022.03 | 36.9 | — | — | 53 | 68.5 | |
| WLPfine-tuned=true2022.03 | 32.1 | — | — | 49.1 | 66 | |
| BFSfine-tuned=true2022.03 | 29 | — | — | 44.7 | 62.1 | |
| ICTfine-tuned=true2022.03 | 28.1 | — | — | 43.8 | 61.8 | |
| No Pre-trainfine-tuned=true2022.03 | 25 | — | — | 40.5 | 58 | |
| Graph Rec Retriever2020.09 | — | 75.7 | 87.5 | — | — | |
| MDRmode=direct2020.09 | — | 65.9 | 75.4 | — | — | |
| MDRmode=reranking2020.09 | — | 81.2 | 88.2 | — | — | |
| Semantic Retrieval2020.09 | — | 63.9 | 77.9 | — | — |