Image Classification on FashionMNIST (Regularization Metrics)
9.05Weight L2 NormAdaptive Weight Decay (AWD)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Adaptive Weight Decay (AWD)lambda_awd=0.01414, Optimizer=SGD2022.09 | 9.05 | 85.42 | 79.24 | 0.44 | |
| Non-adaptive Weight Decaylambda_wd=0.00089, Optimizer=SGD2022.09 | 14.39 | 83.96 | 78.73 | 0.51 |