Passage Retrieval on SQuAD (test)
87.6Top-100 AccuracyXTRxxl
Evaluation results
| Method | Links | ||
|---|---|---|---|
| XTRxxlzero-shot=true2023.04 | 87.6 | 81.1 | |
| XTRbasezero-shot=true2023.04 | 85.9 | 78.2 | |
| DPRmulti + BM25sparse component=true, zero-shot=true2023.04 | 84.4 | 75.1 | |
| SPAR-wiki2023.05 | 83.6 | 73 | |
| BM252023.05 | 81.8 | 71.1 | |
| BM25sparse component=true, zero-shot=true2023.04 | 81.8 | 71.1 | |
| BM25 + DPRTraining=Single, Retriever=BM25 + DPR2020.04 | 81.3 | 71.5 | |
| COS2023.05 | 81.2 | 72.6 | |
| GTRxxlzero-shot=true2023.04 | 80.6 | 70.4 | |
| ART MS MARCOzero-shot=true2023.04 | 80.4 | 68.4 | |
| BM25Training=None, Retriever=BM252020.04 | 80 | 68.8 | |
| BM25 + DPRTraining=Multi, Retriever=BM25 + DPR2020.04 | 78.6 | 66.2 | |
| DCSRTraining Setting=Single2021.10 | 78.1 | 63.7 | |
| DCSRTraining Setting=Multi2021.10 | 77.6 | 63.8 | |
| GTRbasezero-shot=true2023.04 | 77.6 | 65.9 | |
| DPRTraining=Single, Retriever=DPR2020.04 | 77.2 | 63.2 | |
| ColBERTzero-shot=true2023.04 | 76.5 | — | |
| DPRTraining Setting=Single2021.10 | 71 | 52.8 | |
| DPR-multi2023.05 | 67.7 | 52 | |
| DPRmultiretrieval pre-training=true, zero-shot=true2023.04 | 67.7 | 52 | |
| DPRTraining=Multi, Retriever=DPR2020.04 | 67.6 | 51.6 | |
| DPRTraining Setting=Multi2021.10 | 67.6 | 51.6 |