Model Training Optimization on CIFAR-10
1.3392Loss @ Epoch 30Pure Inertia
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Pure InertiaSched.=Pure Inertia, Cfg.=Wrapper Only2026.03 | 1.3392 | 94.31 | — | 1.2811 | — | 96 | |
| ExponentialSched.=Exponential, Cfg.=Enh.2026.03 | 1.345 | 90 | 1.18 | 1.239 | -0.09 | 99 | |
| Cos. RestartSched.=Cos. Restart, Cfg.=Enh.2026.03 | 1.352 | 89.2 | 1.57 | 1.236 | -0.29 | 99 | |
| On PlateauSched.=On Plateau, Cfg.=Enh.2026.03 | 1.359 | 88.6 | 1.88 | 1.238 | -0.86 | 95 | |
| ExponentialSched.=Exponential, Cfg.=Base2026.03 | 1.361 | 88.4 | — | 1.238 | — | 97 | |
| Cos. RestartSched.=Cos. Restart, Cfg.=Base2026.03 | 1.373 | 86.9 | — | 1.232 | — | 97 | |
| PolynomialSched.=Polynomial, Cfg.=Enh.2026.03 | 1.381 | 84.9 | 1.08 | 1.217 | 0.43 | 98 | |
| On PlateauSched.=On Plateau, Cfg.=Base2026.03 | 1.385 | 85.3 | — | 1.228 | — | 99 | |
| Cosine Ann.Sched.=Cosine Ann., Cfg.=Enh.2026.03 | 1.395 | 83.7 | 1.74 | 1.218 | 0.87 | 97 | |
| Multi-StepSched.=Multi-Step, Cfg.=Enh.2026.03 | 1.396 | 85.5 | 2.45 | 1.242 | 0.4 | 92 | |
| Cyclic LRSched.=Cyclic LR, Cfg.=Enh.2026.03 | 1.396 | 87.4 | 2.46 | 1.265 | 0.21 | 99 | |
| PolynomialSched.=Polynomial, Cfg.=Base2026.03 | 1.396 | 83.9 | — | 1.222 | — | 96 | |
| Cosine Ann.Sched.=Cosine Ann., Cfg.=Base2026.03 | 1.419 | 82.2 | — | 1.229 | — | 98 | |
| Multi-StepSched.=Multi-Step, Cfg.=Base2026.03 | 1.431 | 82.6 | — | 1.247 | — | 91 | |
| Cyclic LRSched.=Cyclic LR, Cfg.=Base2026.03 | 1.431 | 84.3 | — | 1.268 | — | 99 | |
| OneCycleSched.=OneCycle, Cfg.=Enh.2026.03 | 1.441 | 80.1 | 1.46 | 1.227 | 1.1 | 97 | |
| OneCycleSched.=OneCycle, Cfg.=Base2026.03 | 1.462 | 79.1 | — | 1.24 | — | 96 |