Story Completion on StoryCloze (0-shot and 32-shot evaluation)
83.3Accuracy (0-shot)OPT-IML 175B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| OPT-IML 175BScale=175B, Instruction Tuning=true2022.12 | 83.3 | 86.4 | |
| OPT 175BScale=175B, Instruction Tuning=false2022.12 | 82.9 | 86.9 | |
| OPT 30BScale=30B, Instruction Tuning=false2022.12 | 80.3 | 84.1 | |
| OPT-IML 30BScale=30B, Instruction Tuning=true2022.12 | 80.1 | 82.7 | |
| OPT 1.3BScale=1.3B, Instruction Tuning=false2022.12 | 74.7 | 74.5 | |
| OPT-IML 1.3BScale=1.3B, Instruction Tuning=true2022.12 | 73.7 | 74.4 |