Classification on WIC
71.5AccuracyAR1-ZO
Evaluation results
| Method | Links | |
|---|---|---|
| AR1-ZOModel=Qwen3-32B, Rank (r)=642026.05 | 71.5 | |
| FT (Adam)Model=OPT-13B2026.05 | 70.1 | |
| MeZO-LoRAModel=Qwen3-32B, Rank (r)=642026.05 | 68.3 | |
| FT (Adam)Model=OPT-2.7B2026.05 | 63.8 | |
| ZO-Alt-NaiveModel=Qwen3-32B2026.05 | 63.3 | |
| AR1-ZOModel=OPT-2.7B, Rank (r)=642026.05 | 60.3 | |
| MeZO-LoRAModel=OPT-2.7B, Rank (r)=642026.05 | 59.7 | |
| AR1-ZOModel=OPT-13B, Rank (r)=642026.05 | 57.5 | |
| LOZOModel=OPT-13B2026.05 | 56.9 | |
| AR1-ZOModel=Qwen3-1.7B, Rank (r)=642026.05 | 56.6 | |
| ZO-Alt-NaiveModel=OPT-13B2026.05 | 55.8 | |
| ZO-Alt-NaiveModel=OPT-2.7B2026.05 | 54.9 | |
| MeZO-LoRAModel=OPT-13B, Rank (r)=642026.05 | 54.9 | |
| LOZOModel=OPT-2.7B2026.05 | 54.4 | |
| MeZO-LoRAModel=Qwen3-1.7B, Rank (r)=642026.05 | 53.3 | |
| ZO-Alt-NaiveModel=Qwen3-1.7B2026.05 | 49.8 |