Sentiment Analysis on SST-2 (Loss, Acc)
94AccuracyLOZO
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LOZOModel=LLaMA-3.1-8B2025.10 | 94 | 0.25 | |
| ZO Fine-tunerModel=LLaMA-3.1-8B2025.10 | 94 | 0.18 | |
| ZO Fine-tunerModel=Qwen2.5-14B2025.10 | 94 | 0.24 | |
| ZO Fine-tunerModel=LLaMA-3.2-1B2025.10 | 93 | 0.14 | |
| HIZOOModel=Qwen2.5-14B2025.10 | 93 | 0.26 | |
| LOZOModel=Qwen2.5-14B2025.10 | 93 | 0.38 | |
| MeZO-AdamModel=LLaMA-3.2-1B2025.10 | 92 | 0.2 | |
| LOZOModel=LLaMA-3.2-1B2025.10 | 92 | 0.2 | |
| MeZOModel=LLaMA-3.1-8B2025.10 | 92 | 0.29 | |
| MeZO-AdamUModel=LLaMA-3.1-8B2025.10 | 92 | 0.36 | |
| HIZOOModel=LLaMA-3.1-8B2025.10 | 92 | 0.27 | |
| MeZOModel=LLaMA-3.2-1B2025.10 | 90 | 0.29 | |
| HIZOOModel=LLaMA-3.2-1B2025.10 | 90 | 0.27 | |
| LOZOModel=OPT-30B2025.10 | 90 | 0.4 | |
| MeZO-AdamUModel=Qwen2.5-14B2025.10 | 89 | 0.35 | |
| MeZOModel=OPT-30B2025.10 | 89 | 0.38 | |
| MeZOModel=Qwen2.5-14B2025.10 | 88 | 0.21 | |
| ZO Fine-tunerModel=OPT-30B2025.10 | 87 | 0.35 | |
| ICRBackbone=Llama2-7B2025.09 | 86.4 | — | |
| HIZOOModel=OPT-30B2025.10 | 86 | 0.43 | |
| IVBackbone=Llama2-7B2025.09 | 85.6 | — | |
| ELICITBackbone=Llama2-7B2025.09 | 84.4 | — | |
| ICVBackbone=Llama2-7B2025.09 | 84.2 | — | |
| MeZO-AdamUModel=OPT-30B2025.10 | 84 | 0.43 | |
| TVBackbone=Llama2-7B2025.09 | 83.4 | — | |
| FVBackbone=Llama2-7B2025.09 | 82.8 | — |