Closed-book Question Answering on Natural Questions (dev)
54.4AccuracyFiD + Distillation
Evaluation results
| Method | Links | |
|---|---|---|
| FiD + Distillationevaluation_protocol=open book2022.03 | 54.4 | |
| Chinchillashots=64-shot2022.03 | 35.5 | |
| Chinchillashots=5-shot2022.03 | 31.5 | |
| GPT-3shots=64-shot2022.03 | 29.9 | |
| Gophershots=64-shot2022.03 | 28.2 | |
| Gophershots=5-shot2022.03 | 24.5 | |
| Chinchillashots=0-shot2022.03 | 16.6 | |
| GPT-3shots=0-shot2022.03 | 14.6 | |
| Gophershots=0-shot2022.03 | 10.1 |