End-to-end Open-Domain Question Answering on TREC (test)
63.1Exact Match (EM)TOURsoft
Evaluation results
| Method | Links | |
|---|---|---|
| TOURsoftTop-k=102022.05 | 63.1 | |
| TOURhardTop-k=202022.05 | 62.5 | |
| TOURsoftTop-k=202022.05 | 62.5 | |
| TOURhardTop-k=102022.05 | 62 | |
| Phrase re-rankerTop-k=402022.05 | 61.5 | |
| Phrase re-rankerTop-k=102022.05 | 60.5 | |
| DPRmulti (large) + Re-rankerTop-k=52022.05 | 55.3 | |
| DensePhrasesmulti + PRFRocchioTop-k=102022.05 | 54 | |
| DensePhrasesmulti2022.05 | 53.9 | |
| DPRmulti (large)2022.05 | 53.5 | |
| BM25+DPRTraining=Multi2020.04 | 50.6 | |
| DPRTraining=Multi2020.04 | 49.4 | |
| DPRmulti2022.05 | 49.4 | |
| DPRmulti + Re-rankerTop-k=52022.05 | 49.3 | |
| REALMWikiTraining=Single, Pretraining=Wikipedia2020.04 | 46.8 | |
| REALMNewsTraining=Single, Pretraining=CC-News2020.04 | 42.9 | |
| ORQATraining=Single2020.04 | 30.1 | |
| BM25+DPRTraining=Single2020.04 | 28 | |
| DPRTraining=Single2020.04 | 25.9 | |
| BM25Training=Single2020.04 | 24.9 | |
| BM25+BERTTraining=Single2020.04 | 21.3 |