Image Classification on Tiny ImageNet (Natural Accuracy and Weight Regularization Metrics)
15.01Weight L2 NormAdaptive Weight Decay (AWD)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Adaptive Weight Decay (AWD)lambda_awd=0.01714, Optimizer=SGD2022.09 | 15.01 | 48.46 | 19.74 | 2.8 | |
| Non-adaptive Weight Decaylambda_wd=0.00211, Optimizer=SGD2022.09 | 25.62 | 47.87 | 16.73 | 3.56 |