Image Classification on ImageNet 4 (val)
83.6AccuracyEfficientNet-B5
Evaluation Results
| Method | Links | |
|---|---|---|
| EfficientNet-B5#Param.=30M, Input=456^2, MACs (M)=103922021.07 | 83.6 | |
| DeiT-B with iRPE-K#Param.=87M, Input=224^2, MACs (M)=176842021.07 | 82.4 | |
| CPVT-B(0-5)#Param.=86M, Input=224^2, MACs (M)=175982021.07 | 81.9 | |
| DeiT-B#Param.=86M, Input=224^2, MACs (M)=175922021.07 | 81.8 | |
| DeiT-S with iRPE-QKV#Param.=22M, Input=224^2, MACs (M)=48852021.07 | 81.4 | |
| DeiT-S with iRPE-QK#Param.=22M, Input=224^2, MACs (M)=47062021.07 | 81.1 | |
| DeiT-S(Huang's)#Param.=22M, Input=224^2, MACs (M)=47062021.07 | 81 | |
| DeiT-S(Shaw's)#Param.=22M, Input=224^2, MACs (M)=46592021.07 | 80.9 | |
| DeiT-S with iRPE-K#Param.=22M, Input=224^2, MACs (M)=46592021.07 | 80.9 | |
| DeiT-S(Trans.-XL's)#Param.=23M, Input=224^2, MACs (M)=48282021.07 | 80.8 | |
| DeiT-S(SASA's)#Param.=22M, Input=224^2, MACs (M)=46392021.07 | 80.8 | |
| CPVT-S(0-5)#Param.=23M, Input=224^2, MACs (M)=46162021.07 | 80.5 | |
| DeiT-S#Param.=22M, Input=224^2, MACs (M)=46132021.07 | 79.9 | |
| RegNetY-4.0GF#Param.=21M, Input=224^2, MACs (M)=40122021.07 | 79.4 | |
| EfficientNet-B1#Param.=8M, Input=240^2, MACs (M)=7122021.07 | 79.1 | |
| ResNet-50#Param.=25M, Input=224^2, MACs (M)=41212021.07 | 79 | |
| Learned Dense Weights (SGD)Model=Wide ResNet-50, # of Parameters=69M2019.11 | 78.1 | |
| ViT-B/16#Param.=86M, Input=384^2, MACs (M)=556302021.07 | 77.9 | |
| ViT-L/16#Param.=307M, Input=384^2, MACs (M)=1914522021.07 | 76.5 | |
| Learned Dense Weights (SGD)Model=ResNet-50, # of Parameters=25M2019.11 | 76.1 | |
| DeiT-Ti with iRPE-K#Param.=6M, Input=224^2, MACs (M)=12842021.07 | 73.7 | |
| CPVT-Ti(0-5)#Param.=6M, Input=224^2, MACs (M)=12622021.07 | 73.4 | |
| Learned Dense Weights (SGD)Model=ResNet-34, # of Parameters=21.8M2019.11 | 73.3 | |
| edge-popupModel=Wide ResNet-50, Initialization=Signed Kaiming Constant, % of Weights=30%, # of Parameters=20.6M2019.11 | 73.3 | |
| edge-popupModel=ResNet-101, Initialization=Signed Kaiming Constant, % of Weights=30%, # of Parameters=13M2019.11 | 72.3 | |
| DeiT-Ti#Param.=5M, Input=224^2, MACs (M)=12612021.07 | 72.2 | |
| edge-popupModel=ResNet-50, Initialization=Signed Kaiming Constant, % of Weights=30%, # of Parameters=7.6M2019.11 | 68.6 | |
| edge-popupModel=Wide ResNet-50, Initialization=Kaiming Normal, % of Weights=30%, # of Parameters=20.6M2019.11 | 67.95 | |
| edge-popupModel=ResNet-101, Initialization=Kaiming Normal, % of Weights=30%, # of Parameters=13M2019.11 | 66.15 | |
| edge-popupModel=ResNet-50, Initialization=Kaiming Normal, % of Weights=30%, # of Parameters=7.6M2019.11 | 61.71 |