General Language Capability on BIG-bench 57 Task
48.7Accuracy (Weighted)GAL 120B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GAL 120BParams (bn)=120, Shot-count=5-shot, Prompt style=Default BIG-Bench2022.11 | 48.7 | 45.3 | |
| GAL 30BParams (bn)=30, Shot-count=5-shot, Prompt style=Default BIG-Bench2022.11 | 46.6 | 42.7 | |
| OPT 175BParams (bn)=175, Shot-count=5-shot, Prompt style=Default BIG-Bench2022.11 | 43.4 | 42.6 | |
| BLOOM 176BParams (bn)=176, Shot-count=5-shot, Prompt style=Default BIG-Bench2022.11 | 42.6 | 42.2 | |
| OPT 30BParams (bn)=30, Shot-count=5-shot, Prompt style=Default BIG-Bench2022.11 | 39.6 | 38 |