Word Sense Disambiguation on WiC SuperGLUE (test dev)
0.72AccuracyAdam
Evaluation Results
| Method | Links | |
|---|---|---|
| AdamModel=Gemma2-2B, Evaluation Protocol=Fine-tuning2026.02 | 0.72 | |
| ZO-MuonModel=Gemma2-2B, Evaluation Protocol=Fine-tuning2026.02 | 0.603 | |
| SubZeroModel=Gemma2-2B, Evaluation Protocol=Fine-tuning2026.02 | 0.583 | |
| MeZOModel=Gemma2-2B, Evaluation Protocol=Fine-tuning2026.02 | 0.571 | |
| LoRAModel=Gemma2-2B, Evaluation Protocol=Fine-tuning2026.02 | 0.561 | |
| S-MeZOModel=Gemma2-2B, Evaluation Protocol=Fine-tuning2026.02 | 0.558 | |
| HiZOOModel=Gemma2-2B, Evaluation Protocol=Fine-tuning2026.02 | 0.552 | |
| LOZOModel=Gemma2-2B, Evaluation Protocol=Fine-tuning2026.02 | 0.502 |