Question Answering on TriviaQA (PPL)
1.408PPLConventional
Evaluation results
| Method | Links | |
|---|---|---|
| ConventionalSize=1074M2026.02 | 1.408 | |
| HourglassSize=1074M2026.02 | 1.422 | |
| Conventional (OLMo-2)Size=1074M2026.02 | 1.428 | |
| HourglassSize=906M2026.02 | 1.489 | |
| ConventionalSize=906M2026.02 | 1.505 | |
| ConventionalSize=403M2026.02 | 1.586 | |
| HourglassSize=403M2026.02 | 1.591 | |
| HourglassSize=113M2026.02 | 1.877 | |
| ConventionalSize=113M2026.02 | 1.914 |