Natural Language Inference on CB (0-shot and 32-shot)
82.1Acc (0-shot)OPT-IML 30B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| OPT-IML 30BScale=30B2022.12 | 82.1 | 78.6 | |
| OPT-IML 175BScale=175B2022.12 | 69.6 | 53.6 | |
| OPT-IML 1.3BScale=1.3B2022.12 | 67.9 | 51.8 | |
| OPT 175BScale=175B2022.12 | 46.4 | 70 | |
| OPT 1.3BScale=1.3B2022.12 | 42.9 | 51.8 | |
| OPT 30BScale=30B2022.12 | 28.6 | 5.7 |