Open-Domain Question Answering Retrieval on EntityQuestions (test)
76.3Accuracy@20COS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| COS2023.05 | 76.3 | 82.4 | |
| SPAR-PAQtype=dense, zero-shot=true, averaging=micro-average2021.10 | 74 | 82 | |
| SPARtype=dense, zero-shot=true, averaging=micro-average2021.10 | 73.6 | 81.5 | |
| SPAR-wiki2023.05 | 73.6 | 81.5 | |
| DPR + BM25type=hybrid, zero-shot=true, averaging=micro-average2021.10 | 73.3 | 82.3 | |
| BM25type=sparse, zero-shot=true, averaging=micro-average2021.10 | 70.8 | 79.2 | |
| BM252023.05 | 70.8 | 79.2 | |
| BM25Zero-shot=true2023.05 | 70.8 | 79.2 | |
| COS (pretrain-only)Zero-shot=true2023.05 | 70.7 | 79.1 | |
| PAQ Λtype=dense, zero-shot=true, averaging=micro-average, training_source=PAQ2021.10 | 69.4 | 78.6 | |
| Wiki Λtype=dense, zero-shot=true, averaging=micro-average, training_source=Wikipedia2021.10 | 68.4 | 77.5 | |
| SpiderZero-shot=true2023.05 | 65.1 | 76.4 | |
| ContrieverZero-shot=true2023.05 | 61.8 | 74.2 | |
| DPRtype=dense, zero-shot=true, averaging=micro-average2021.10 | 56.6 | 70.1 | |
| DPR-multi2023.05 | 56.6 | 70.1 |