Physical Commonsense Reasoning on PIQA (0-shot and 32-shot)
79.8Accuracy (0-shot)OPT-IML 175B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| OPT-IML 175BScale=175B2022.12 | 79.8 | 80.5 | |
| OPT 175BScale=175B2022.12 | 79.5 | 81.6 | |
| OPT 30BScale=30B2022.12 | 77.5 | 78.8 | |
| OPT-IML 30BScale=30B2022.12 | 77.3 | 69.2 | |
| OPT 1.3BScale=1.3B2022.12 | 72.3 | 72.6 | |
| OPT-IML 1.3BScale=1.3B2022.12 | 71.8 | 72.1 |