Language Understanding and Generation on Language Tasks Suite (OPT-13B, test)
92.7SST-2 AccuracyAdaMeZO
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AdaMeZOModel=OPT-13B2026.05 | 92.7 | 63 | 67.8 | 70.6 | 58.4 | 55.8 | 58.3 | 87 | 80.1 | 83.7 | 31 | 68 | 70.4 | |
| MeZO-switchModel=OPT-13B2026.05 | 92.6 | 61.6 | 66.9 | 66.2 | 56.9 | 55.4 | 57.5 | 86 | 80.5 | 83.4 | 30.5 | 67 | 69.3 | |
| MeZOModel=OPT-13B2026.05 | 92.1 | 60.4 | 67.8 | 65.5 | 56.6 | 54.9 | 56.7 | 87 | 80.2 | 82.1 | 30.6 | 66.7 | 69 | |
| FOModel=OPT-13B, Memory=≥ 4× memory2026.05 | 92 | 70.8 | 83.9 | 77.1 | 63.5 | 55 | 71.1 | 79 | 74.1 | 84.9 | 31.3 | 71.1 | 74 | |
| HiZOOModel=OPT-13B2026.05 | 91.5 | 62.5 | 68.2 | — | 56.4 | 55.4 | 57.5 | 86.2 | 80 | 83.5 | — | — | — | |
| Zero-shotModel=OPT-13B2026.05 | 58.8 | 59.6 | 46.4 | 59 | 38.5 | 55 | 46.9 | 80 | 81.2 | 46.2 | 14.6 | 53.2 | 58.3 |