Sentiment Analysis on SST-2 1k (test)
95.3AccuracyAdam
Evaluation results
| Method | Links | |
|---|---|---|
| AdamBackbone=OPT-13B, Steps=625, Queries=625, Runtime=10min, Memory=4 × 63.7 GB2026.05 | 95.3 | |
| LoRABackbone=OPT-13B, Steps=625, Queries=625, Runtime=6min, Memory=2 × 52.7 GB2026.05 | 94.8 | |
| ZO-MOPIBackbone=OPT-13B, Steps=4k, Queries=20k, Runtime=2.03h, Memory=26.56GB2026.05 | 91.7 | |
| ZO-MuonBackbone=OPT-13B, Steps=4k, Queries=20k, Runtime=2.05h, Memory=26.22GB2026.05 | 90.4 | |
| MeZOBackbone=OPT-13B, Steps=10k, Queries=20k, Runtime=2.74h, Memory=25.86GB2026.05 | 88.3 | |
| LOZOBackbone=OPT-13B, Steps=10k, Queries=20k, Runtime=2.64h, Memory=25.40GB2026.05 | 87.7 |