Question Answering on OpenBookQA (0-shot and 32-shot evaluation)
58.4Accuracy (0-shot)OPT 175B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OPT 175BScale=175B2022.12 | 58.4 | 64.5 | |
| OPT-IML 175BScale=175B2022.12 | 58.2 | 65 | |
| OPT 30BScale=30B2022.12 | 57.2 | 60.1 | |
| OPT-IML 30BScale=30B2022.12 | 50.6 | 55.2 | |
| OPT 1.3BScale=1.3B2022.12 | 46.8 | 47.6 | |
| OPT-IML 1.3BScale=1.3B2022.12 | 45 | 44.8 |