Passage retrieval on TREC (test)
95.5Top-20 AccuracyGAR best query
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GAR best queryTraining Setting=Transfer from NQ2023.05 | 95.5 | 97.1 | 93.1 | |
| GAR best queryTraining Setting=Transfer from TriviaQA2023.05 | 95.2 | 96.8 | 92.5 | |
| DPRTraining=Multi, Retriever=DPR2020.04 | 89.1 | 93.9 | — | |
| EAR-RDTraining Setting=Transfer from NQ2023.05 | 88.9 | 93.7 | 80 | |
| BM25 + DPRTraining=Multi, Retriever=BM25 + DPR2020.04 | 88.5 | 94.1 | — | |
| EAR-RDTraining Setting=Transfer from TriviaQA2023.05 | 88.5 | 93.1 | 79.8 | |
| DPR+Training Setting=Transfer from TriviaQA2023.05 | 87.9 | 93.7 | 78.8 | |
| EAR-RITraining Setting=Transfer from TriviaQA2023.05 | 86.2 | 92.5 | 74.2 | |
| DPR+Training Setting=Transfer from NQ2023.05 | 85.9 | 92.1 | 74.1 | |
| EAR-RITraining Setting=Transfer from NQ2023.05 | 85.9 | 92.9 | 73.5 | |
| BM25 + DPRTraining=Single, Retriever=BM25 + DPR2020.04 | 85.2 | 92.7 | — | |
| GARTraining Setting=Transfer from TriviaQA2023.05 | 84 | 91.5 | 71.5 | |
| GARTraining Setting=Transfer from NQ2023.05 | 83.9 | 92.4 | 70.9 | |
| DPR+Training Setting=In-Domain Supervised2023.05 | 81.7 | 89.9 | 66.6 | |
| BM25Training Setting=N/A2023.05 | 80.7 | 89.9 | 64.3 | |
| DPRTraining=Single, Retriever=DPR2020.04 | 78.8 | 89.1 | — | |
| BM25Training=None, Retriever=BM252020.04 | 70.9 | 84.1 | — |