Natural Language Understanding on GLUE and SuperGLUE (val)
91.6SST-2 ScoreSubZero-GV(prefix)
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SubZero-GV(prefix)Backbone=OPT-30B, Protocol=Prefix-tuning2026.01 | 91.6 | 75.1 | 79.4 | 61.5 | 62.9 | |
| MeZO-GV(prefix)Backbone=OPT-30B, Protocol=Prefix-tuning2026.01 | 91.4 | 75.8 | 77.4 | 61.5 | 62.7 | |
| SubZero (prefix)Backbone=OPT-30B, Protocol=Prefix-tuning2026.01 | 89.3 | 74 | 76.8 | 59.6 | 58.3 | |
| MeZO (prefix)Backbone=OPT-30B, Protocol=Prefix-tuning2026.01 | 87.5 | 72.6 | 73.5 | 55.7 | 59.1 | |
| ICLBackbone=OPT-30B, Protocol=In-context learning2026.01 | 81.9 | 66.8 | 66.2 | 56.7 | 51.3 | |
| Zero-shotBackbone=OPT-30B, Protocol=Zero-shot2026.01 | 56.7 | 52 | 39.1 | 38.5 | 50.2 |