Image Classification on CIFAR-10 (Accuracy and Weight Regularization Analysis)
7.11L2 Norm WeightAdaptive Weight Decay (AWD)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Adaptive Weight Decay (AWD)lambda_awd=0.022, Optimizer=SGD2022.09 | 7.11 | 87.08 | 50.03 | 0.08 | |
| Non-adaptive Weight Decaylambda_wd=0.00089, Optimizer=SGD2022.09 | 35.58 | 84.31 | 45.19 | 0.58 |