Image Classification on ImageNet 1k (pretraining)
81.19Top-1 AccuracyAdamCPR
Evaluation Results
| Method | Links | |
|---|---|---|
| AdamCPRBackbone=DeiT-Base, Number of Parameters=86M, Kappa WS (x lr-warmup)=1x2023.11 | 81.19 | |
| AdamCPRBackbone=DeiT-Base, Number of Parameters=86M, Initialization=Kappa IP2023.11 | 80.95 | |
| AdamWBackbone=DeiT-Base, Number of Parameters=86M, weight decay=0.52023.11 | 80.56 | |
| AdamCPRBackbone=DeiT-Small, Number of Parameters=22M, Initialization=Kappa IP2023.11 | 79.84 | |
| AdamCPRBackbone=DeiT-Small, Number of Parameters=22M, Kappa WS (x lr-warmup)=1x2023.11 | 79.81 | |
| AdamCPRBackbone=DeiT-Base, Number of Parameters=86M, Kappa WS (x lr-warmup)=2x2023.11 | 79.61 | |
| AdamCPRBackbone=DeiT-Small, Number of Parameters=22M, Kappa WS (x lr-warmup)=2x2023.11 | 79.33 | |
| AdamWBackbone=DeiT-Small, Number of Parameters=22M, weight decay=0.52023.11 | 79.16 | |
| AdamWBackbone=DeiT-Small, Number of Parameters=22M, weight decay=0.052023.11 | 79.03 | |
| AdamWBackbone=DeiT-Base, Number of Parameters=86M, weight decay=0.052023.11 | 78.59 | |
| AdamCPRBackbone=DeiT-Small, Number of Parameters=22M, Kappa WS (x lr-warmup)=4x2023.11 | 78.04 | |
| AdamWBackbone=DeiT-Small, Number of Parameters=22M, weight decay=0.0052023.11 | 76.97 | |
| AdamWBackbone=DeiT-Base, Number of Parameters=86M, weight decay=0.0052023.11 | 76.19 |