Open-domain Question Answering on SQuAD Open-domain 1.1 (test)
61.8Exact Match (EM)IRRR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| IRRRTraining Data=SQuAD + HotpotQA2020.10 | 61.8 | 68.9 | |
| SPARTARanker Backbone=bert-base-uncased, Reader Backbone=SpanBERT2020.09 | 59.3 | 66.5 | |
| SPARTA2020.10 | 59.3 | 66.5 | |
| IRRRTraining Data=SQuAD2020.10 | 56.8 | 63.2 | |
| FiD2020.10 | 56.7 | — | |
| Graph-retriever2020.09 | 56.5 | 63.8 | |
| PathRetrieverTraining=Single2020.04 | 56.5 | — | |
| GRR2020.10 | 56.5 | 63.8 | |
| Multi-passage2020.09 | 53 | 60.9 | |
| Multi-passage BERT2020.10 | 53 | 60.9 | |
| Knowledge-aided2020.10 | 43.6 | 53.4 | |
| RE 32020.09 | 41.9 | 50.2 | |
| RE³2020.10 | 41.9 | 50.2 | |
| MUPPET2020.10 | 39.3 | 46.2 | |
| BERTserini2020.09 | 38.6 | 46.1 | |
| BERTserini2020.10 | 38.6 | 46.1 | |
| BM25Training=Single2020.04 | 38.1 | — | |
| DensePR2020.10 | 38.1 | — | |
| BM25+DPRTraining=Single2020.04 | 36.7 | — | |
| DenSPI-hybrid2020.09 | 36.2 | 44.4 | |
| BM25+DPRTraining=Multi2020.04 | 35.8 | — | |
| BM25+BERTTraining=Single2020.04 | 33.2 | — | |
| MINIMAL2020.09 | 32.7 | 42.5 | |
| Par. ranker2020.09 | 30.2 | — | |
| Dr.QA2020.09 | 29.8 | — | |
| DPRTraining=Single2020.04 | 29.8 | — | |
| R32020.09 | 29.1 | 37.5 | |
| DrQA2020.10 | 27.1 | — | |
| DPRTraining=Multi2020.04 | 24.1 | — | |
| ORQATraining=Single2020.04 | 20.2 | — |