Image Classification on SVHN (Natural Accuracy and Regularization Analysis)
102.11L2 Weight NormNon-adaptive Weight Decay
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Non-adaptive Weight Decaylambda_wd=5e-7, Optimizer=SGD2022.09 | 102.11 | 92.04 | 44.16 | 1.02 | |
| Adaptive Weight Decay (AWD)lambda_awd=0.02378, Optimizer=SGD2022.09 | 5.39 | 93.04 | 47.1 | 1.15 |