Open-domain Question Answering on Natural Questions (NQ) Karpukhin et al. (val)
16.1EMClosed-Book QA w. Mixed Training + Recitation
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Closed-Book QA w. Mixed Training + RecitationTraining Strategy=Mixed Training, Recitation=true2024.03 | 16.1 | 20.1 | 28.6 | |
| Closed-Book QA w. Continual Training + RecitationTraining Strategy=Continual Training, Recitation=true2024.03 | 13.4 | 16.9 | 25.6 | |
| Closed-Book QA w. Mixed TrainingTraining Strategy=Mixed Training2024.03 | 12.6 | 18.2 | — | |
| Closed-Book QA w. Continual TrainingTraining Strategy=Continual Training2024.03 | 10.3 | 15.5 | — | |
| Closed-Book QATraining Strategy=None (Prior Knowledge)2024.03 | 10.1 | 14.8 | — |