Retrieval on Entity Questions (test)
91.8Top-100 Retrieval AccuracyGAR best query
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GAR best queryTraining Setting=Transfer from TriviaQA2023.05 | 91.8 | 79.1 | 85.9 | |
| GAR best queryTraining Setting=Transfer from NQ2023.05 | 90.9 | 78.6 | 85.2 | |
| XTRxxlzero-shot=true2023.04 | 85.9 | — | 79.4 | |
| XTRbasezero-shot=true2023.04 | 85.2 | — | 79 | |
| DPRmulti + BM25sparse component=true, zero-shot=true2023.04 | 82.6 | — | 73.3 | |
| GTRxxlzero-shot=true2023.04 | 82.5 | — | 75.3 | |
| ART MS MARCOzero-shot=true2023.04 | 81.9 | — | 75.3 | |
| EAR-RDTraining Setting=Transfer from NQ2023.05 | 81.5 | 65.5 | 74.1 | |
| EAR-RITraining Setting=Transfer from NQ2023.05 | 81.4 | 62.7 | 73.3 | |
| GTRbasezero-shot=true2023.04 | 80.6 | — | 73.3 | |
| EAR-RDTraining Setting=Transfer from TriviaQA2023.05 | 80.5 | 64.9 | 73 | |
| EAR-RITraining Setting=Transfer from TriviaQA2023.05 | 80.4 | 62.1 | 72 | |
| BM25sparse component=true, zero-shot=true2023.04 | 80 | — | 71.4 | |
| GARTraining Setting=Transfer from NQ2023.05 | 79.8 | 59.7 | 71 | |
| BM25Training Setting=N/A2023.05 | 79.2 | 60.6 | 70.8 | |
| ColBERTzero-shot=true2023.04 | 79.1 | — | — | |
| GARTraining Setting=Transfer from TriviaQA2023.05 | 78.7 | 58.2 | 68.9 | |
| DPR+Training Setting=Transfer from TriviaQA2023.05 | 74.6 | 51.2 | 62.7 | |
| DPRmultiretrieval pre-training=true, zero-shot=true2023.04 | 70 | — | 56.7 | |
| DPR+Training Setting=Transfer from NQ2023.05 | 63.2 | 38.1 | 49.7 |