Open-Domain Question Answering on NaturalQuestions (NQ) v1.0 (test)
83Acc@20SPAR-Wiki
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SPAR-WikiModel Type=dense, Teacher=BM25, Base Model=Wiki2021.10 | 83 | 88.8 | |
| RocketQAModel Type=dense2021.10 | 82.7 | 88.5 | |
| SPAR-PAQModel Type=dense, Teacher=BM25, Base Model=PAQ2021.10 | 82.7 | 88.6 | |
| DPR + BM25Model Type=hybrid2021.10 | 82.6 | 88.6 | |
| xMoCoModel Type=dense2021.10 | 82.5 | 86.3 | |
| SPAR-MARCOModel Type=dense, Evaluation Mode=Cross-dataset model generalization2021.10 | 82.3 | 88.5 | |
| ANCEModel Type=dense2021.10 | 82.1 | 87.9 | |
| DPR multiModel Type=dense2021.10 | 79.5 | 86.1 | |
| PAQ AModel Type=dense2021.10 | 63.8 | 78.6 | |
| BM25Model Type=sparse2021.10 | 62.9 | 78.3 | |
| Wiki AModel Type=dense2021.10 | 62 | 77.4 |