Natural Language Understanding on SuperGLUE (Partial Task Evaluation)
96SST-2 AccuracyAdam
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| AdamBackbone=LlaMA3-8B, Fine-tuning protocol=Full Fine-tuning2026.02 | 96 | 92 | 92 | 86.6 | 72.6 | |
| AdamBackbone=OPT-13B, Fine-tuning protocol=Full Fine-tuning2026.02 | 95.3 | 80.9 | 94.6 | 83.5 | 66.3 | |
| LoRABackbone=LlaMA3-8B, Fine-tuning protocol=LoRA2026.02 | 95 | 80.9 | 73.2 | 86.4 | 70.7 | |
| LoRABackbone=OPT-13B, Fine-tuning protocol=LoRA2026.02 | 94.8 | 78.3 | 69.6 | 80.2 | 64.3 | |
| ZO-MuonBackbone=LlaMA3-8B, Fine-tuning protocol=Full Fine-tuning2026.02 | 94.3 | 81.2 | 69.6 | 82.9 | 65.2 | |
| HiZOOBackbone=LlaMA3-8B, Fine-tuning protocol=Full Fine-tuning2026.02 | 93.5 | 75.1 | 69.6 | 80 | 59.7 | |
| MeZOBackbone=LlaMA3-8B, Fine-tuning protocol=Full Fine-tuning2026.02 | 92.7 | 74.4 | 69.6 | 76.7 | 57.8 | |
| LOZOBackbone=LlaMA3-8B, Fine-tuning protocol=Full Fine-tuning2026.02 | 92.5 | 66.8 | 69.6 | 79.4 | 55.8 | |
| ZO-MuonBackbone=OPT-13B, Fine-tuning protocol=Full Fine-tuning2026.02 | 92.5 | 72.9 | 71.4 | 72.4 | 61.7 | |
| Subspace-MeZOBackbone=LlaMA3-8B, Fine-tuning protocol=Full Fine-tuning2026.02 | 92.3 | 68.6 | 69.6 | 80 | 62.9 | |
| S-MeZOBackbone=LlaMA3-8B, Fine-tuning protocol=Full Fine-tuning2026.02 | 92.1 | 69.7 | 69.6 | 80.5 | 56.9 | |
| SubZeroBackbone=LlaMA3-8B, Fine-tuning protocol=Full Fine-tuning2026.02 | 92.1 | 71.4 | 67.9 | 82 | 58.8 | |
| HiZOOBackbone=OPT-13B, Fine-tuning protocol=Full Fine-tuning2026.02 | 92.1 | 69.3 | 69.6 | 67.6 | 59.4 | |
| SubZeroBackbone=OPT-13B, Fine-tuning protocol=Full Fine-tuning2026.02 | 92.1 | 71.8 | 71.4 | 70.8 | 60.8 | |
| LOZOBackbone=OPT-13B, Fine-tuning protocol=Full Fine-tuning2026.02 | 91.7 | 70.4 | 69.6 | 71.9 | 60.2 | |
| Subspace-MeZOBackbone=OPT-13B, Fine-tuning protocol=Full Fine-tuning2026.02 | 91.7 | 70.7 | 71.4 | 68.1 | 61.7 | |
| MeZOBackbone=OPT-13B, Fine-tuning protocol=Full Fine-tuning2026.02 | 91.4 | 66.1 | 66 | 66.1 | 59.4 | |
| S-MeZOBackbone=OPT-13B, Fine-tuning protocol=Full Fine-tuning2026.02 | 90.4 | 63.5 | 69.6 | 66.4 | 58.8 |