Closed-book Question Answering on TriviaQA (standard)
71.2AccuracyGPT-3
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-3shots=64-shot2021.12 | 71.2 | |
| GPT-3shots=1-shot2021.12 | 68 | |
| GPT-3shots=0-shot2021.12 | 64.2 | |
| Gopher 280Bshots=64-shot, parameters=280B2021.12 | 57.2 | |
| Gopher 7.1Bshots=64-shot, parameters=7.1B2021.12 | 36.1 | |
| Gopher 7.1Bshots=5-shots, parameters=7.1B2021.12 | 33.9 | |
| Gopher 7.1Bshots=1-shot, parameters=7.1B2021.12 | 31.1 | |
| Gopher 7.1Bshots=0-shot, parameters=7.1B2021.12 | 19.9 | |
| Gopher 1Bshots=64-shot, parameters=1B2021.12 | 18.8 | |
| Gopher 1Bshots=5-shots, parameters=1B2021.12 | 17.7 | |
| Gopher 1Bshots=1-shot, parameters=1B2021.12 | 14.2 | |
| Gopher 417Mshots=64-shot, parameters=417M2021.12 | 8.6 | |
| Gopher 417Mshots=5-shots, parameters=417M2021.12 | 7.7 | |
| Gopher 1Bshots=0-shot, parameters=1B2021.12 | 6.5 | |
| Gopher 417Mshots=1-shot, parameters=417M2021.12 | 5.8 | |
| Gopher 117Mshots=64-shot, parameters=117M2021.12 | 3.8 | |
| Gopher 117Mshots=5-shots, parameters=117M2021.12 | 3.4 | |
| Gopher 117Mshots=1-shot, parameters=117M2021.12 | 2.1 | |
| Gopher 44Mshots=5-shots, parameters=44M2021.12 | 1.7 | |
| Gopher 44Mshots=64-shot, parameters=44M2021.12 | 1 | |
| Gopher 417Mshots=0-shot, parameters=417M2021.12 | 0.7 | |
| Gopher 44Mshots=1-shot, parameters=44M2021.12 | 0.6 | |
| Gopher 117Mshots=0-shot, parameters=117M2021.12 | 0.3 | |
| Gopher 44Mshots=0-shot, parameters=44M2021.12 | 0.1 |