Image Classification on ImageNet-1K (val) (Top-1 Accuracy and Speedup)
87.8Top-1 AccuracyRepLKNet-XL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RepLKNet-XLInput resolution=320x320, Params (M)=335, FLOPs (G)=128.7, Throughput (examples/s)=39.1, Pre-training=Extra data2022.03 | 87.8 | — | |
| Swin-LInput resolution=384x384, Params (M)=197, FLOPs (G)=103.9, Throughput (examples/s)=36.2, Pre-training=ImageNet-22K2022.03 | 87.3 | — | |
| RepLKNet-31LInput resolution=384x384, Params (M)=172, FLOPs (G)=96.0, Throughput (examples/s)=50.2, Pre-training=ImageNet-22K2022.03 | 86.6 | — | |
| Swin-BInput resolution=384x384, Pre-training=ImageNet-22K2022.03 | 86.4 | — | |
| RepLKNet-31BInput resolution=384x384, Pre-training=ImageNet-22K2022.03 | 86 | — | |
| RepLKNet-31BInput resolution=224x224, Pre-training=ImageNet-22K2022.03 | 85.2 | — | |
| Swin-BInput resolution=224x224, Pre-training=ImageNet-22K2022.03 | 85.2 | — | |
| RepLKNet-31BInput resolution=384x384, Params (M)=79, FLOPs (G)=45.1, Throughput (examples/s)=97.0, Pre-training=ImageNet-1K2022.03 | 84.8 | — | |
| Swin-BInput resolution=384x384, Params (M)=88, FLOPs (G)=47.0, Throughput (examples/s)=67.9, Pre-training=ImageNet-1K2022.03 | 84.5 | — | |
| CSWin-T#Param.=23M, FLOPs=14.0G, Resolution=384x384, Training Protocol=finetuned2021.07 | 84.3 | — | |
| EfficientNet-B6Input resolution=528^2, # Params (M)=43, FLOPs (B)=192022.01 | 84 | — | |
| EfficientNet-B5Input resolution=456^2, # Params (M)=30, FLOPs (B)=9.92022.01 | 83.6 | — | |
| CViTc-15#Param.=28M, FLOPs=21.4G, Resolution=384x384, Training Protocol=finetuned2021.07 | 83.5 | — | |
| Swin-BInput resolution=224^2, # Params (M)=88, FLOPs (B)=15.42022.01 | 83.5 | — | |
| RepLKNet-31BInput resolution=224x224, Params (M)=79, FLOPs (G)=15.3, Throughput (examples/s)=295.5, Pre-training=ImageNet-1K2022.03 | 83.5 | — | |
| Swin-BInput resolution=224x224, Params (M)=88, FLOPs (G)=15.4, Throughput (examples/s)=226.2, Pre-training=ImageNet-1K2022.03 | 83.5 | — | |
| T2T-14#Param.=22M, FLOPs=17.1G, Resolution=384x384, Training Protocol=finetuned2021.07 | 83.3 | — | |
| AS-MLP-BInput resolution=224^2, # Params (M)=88, FLOPs (B)=15.22022.01 | 83.3 | — | |
| Shift-BInput resolution=224^2, # Params (M)=88, FLOPs (B)=15.22022.01 | 83.3 | — | |
| NVIT-B#FLOPs=6.8G, Speedup=1.85x2021.10 | 83.29 | — | |
| AS-MLP-SInput resolution=224^2, # Params (M)=50, FLOPs (B)=8.52022.01 | 83.1 | — | |
| VisformerV2-SElite setting=false, FLOPs (G)=4.3, Batch Time (ms)=43, Batch size=322021.04 | 83 | — | |
| CvT-13#Param.=20M, FLOPs=16.3G, Resolution=384x384, Training Protocol=finetuned2021.07 | 83 | — | |
| Swin-SInput resolution=224^2, # Params (M)=50, FLOPs (B)=8.72022.01 | 83 | — | |
| NVIT-H#FLOPs=6.2G, Speedup=1.99x2021.10 | 82.95 | — | |
| S²VITE-B-40#FLOPs=11.7G, Speedup=1.33x2021.10 | 82.92 | — | |
| EfficientNet-B4Elite setting=false, FLOPs (G)=4.2, Batch Time (ms)=81.7, Batch size=322021.04 | 82.9 | — | |
| Eff-B4*#Param.=19M, FLOPs=4.2G, Resolution=224x224, Training Protocol=trained2021.07 | 82.9 | — | |
| RegNetY-16GInput resolution=224^2, # Params (M)=84, FLOPs (B)=162022.01 | 82.9 | — | |
| EfficientNet-B4Input resolution=380^2, # Params (M)=19, FLOPs (B)=4.22022.01 | 82.9 | — | |
| AutoFormer-B#FLOPs=11G, Speedup=1.34x2021.10 | 82.9 | — | |
| Shift-SInput resolution=224^2, # Params (M)=50, FLOPs (B)=8.52022.01 | 82.8 | — | |
| CSwin-TElite setting=false, FLOPs (G)=4.3, Batch Time (ms)=57.5, Batch size=322021.04 | 82.7 | — | |
| CSWin-T#Param.=23M, FLOPs=4.3G, Resolution=224x224, Training Protocol=trained2021.07 | 82.7 | — | |
| TCFormer#Param.=25.6M, FLOPs=5.9G, Input size=224x2242022.04 | 82.4 | — | |
| SPVIT#FLOPs=8.4G2021.10 | 82.4 | — | |
| Visf-S#Param.=40M, FLOPs=4.9G, Resolution=224x224, Training Protocol=trained2021.07 | 82.3 | — | |
| Visformer-SElite setting=false, FLOPs (G)=4.9, Batch Time (ms)=36.7, Batch size=322021.04 | 82.2 | — | |
| NVIT-S#FLOPs=4.2G, Speedup=2.47x2021.10 | 82.19 | — | |
| PVTv2-B2-LiElite setting=false, FLOPs (G)=3.9, Batch Time (ms)=56.8, Batch size=322021.04 | 82.1 | — | |
| EVIT-DeiT-B#FLOPs=11.6G, Speedup=1.59x2021.10 | 82.1 | — | |
| PVTv2-B2Elite setting=false, FLOPs (G)=4, Batch Time (ms)=57.1, Batch size=322021.04 | 82 | — | |
| ViL-S#Param.=25M, FLOPs=4.9G, Resolution=224x224, Training Protocol=trained2021.07 | 82 | — | |
| CoaTL-S#Param.=20M, FLOPs=4.0G, Resolution=224x224, Training Protocol=trained2021.07 | 81.9 | — | |
| DeiT-BInput resolution=224^2, # Params (M)=86, FLOPs (B)=17.52022.01 | 81.8 | — | |
| RegNetY-8GInput resolution=224^2, # Params (M)=39, FLOPs (B)=82022.01 | 81.7 | — | |
| PVT-LInput resolution=224^2, # Params (M)=61, FLOPs (B)=9.82022.01 | 81.7 | — | |
| Shift-TInput resolution=224^2, # Params (M)=28, FLOPs (B)=4.42022.01 | 81.7 | — | |
| PVT-Large#Param.=61.4M, FLOPs=9.8G, Input size=224x2242022.04 | 81.7 | — | |
| EfficientNet-B3Elite setting=false, FLOPs (G)=1.8, Batch Time (ms)=48.3, Batch size=322021.04 | 81.6 | — | |
| CvT-13#Param.=20M, FLOPs=4.5G, Resolution=224x224, Training Protocol=trained2021.07 | 81.6 | — | |
| gMLP-BInput resolution=224^2, # Params (M)=73, FLOPs (B)=15.82022.01 | 81.6 | — | |
| T2T-14#Param.=22M, FLOPs=5.2G, Resolution=224x224, Training Protocol=trained2021.07 | 81.5 | — | |
| CPVT-S#Param.=23M, FLOPs=4.6G, Resolution=224x224, Training Protocol=trained2021.07 | 81.5 | — | |
| Swin-TElite setting=false, FLOPs (G)=4.5, Batch Time (ms)=47.6, Batch size=322021.04 | 81.3 | — | |
| TNT-S#Param.=24M, FLOPs=5.2G, Resolution=224x224, Training Protocol=trained2021.07 | 81.3 | — | |
| Swin-T#Param.=29M, FLOPs=4.5G, Resolution=224x224, Training Protocol=trained2021.07 | 81.3 | — | |
| Swin-TInput resolution=224^2, # Params (M)=29, FLOPs (B)=4.52022.01 | 81.3 | — | |
| AS-MLP-TInput resolution=224^2, # Params (M)=28, FLOPs (B)=4.42022.01 | 81.3 | — | |
| Swin-T#Param.=29.0M, FLOPs=4.5G, Input size=224x2242022.04 | 81.3 | — | |
| HRFormer-S#Param.=13.5M, FLOPs=3.6G, Input size=224x2242022.04 | 81.2 | — | |
| CViT-15#Param.=27M, FLOPs=5.6G, Resolution=224x224, Training Protocol=trained2021.07 | 81 | — | |
| LVIT-S#Param.=22M, FLOPs=4.6G, Resolution=224x224, Training Protocol=trained2021.07 | 80.8 | — | |
| S^2-MLP-WInput resolution=224^2, # Params (M)=51, FLOPs (B)=10.52022.01 | 80.7 | — | |
| T2T-ViTt-14#Param.=22.0M, FLOPs=6.1G, Input size=224x2242022.04 | 80.7 | — | |
| DeiT-SElite setting=true, FLOPs (G)=4.6, Batch Time (ms)=36.9, Batch size=322021.04 | 80.1 | — | |
| RegNetY-4GFElite setting=true, FLOPs (G)=4, Batch Time (ms)=40.2, Batch size=322021.04 | 80 | — | |
| Reg-4G#Param.=21M, FLOPs=4.0G, Resolution=224x224, Training Protocol=trained2021.07 | 80 | — | |
| RegNetY-4GInput resolution=224^2, # Params (M)=21, FLOPs (B)=42022.01 | 80 | — | |
| S^2-MLP-DInput resolution=224^2, # Params (M)=71, FLOPs (B)=142022.01 | 80 | — | |
| DeiT-Small/16#Param.=22.1M, FLOPs=4.6G, Input size=224x2242022.04 | 79.9 | — | |
| PVT-SElite setting=false, FLOPs (G)=3.8, Batch Time (ms)=47.6, Batch size=322021.04 | 79.8 | — | |
| DeiT-S#Param.=22M, FLOPs=4.6G, Resolution=224x224, Training Protocol=trained2021.07 | 79.8 | — | |
| PVT-S#Param.=25M, FLOPs=3.8G, Resolution=224x224, Training Protocol=trained2021.07 | 79.8 | — | |
| DeiT-SInput resolution=224^2, # Params (M)=22, FLOPs (B)=4.62022.01 | 79.8 | — | |
| PVT-SInput resolution=224^2, # Params (M)=25, FLOPs (B)=3.82022.01 | 79.8 | — | |
| gMLP-SInput resolution=224^2, # Params (M)=20, FLOPs (B)=4.52022.01 | 79.4 | — | |
| SReT w/ FKDNetwork=SReT-LT, Epochs=300, #Params (M)=5.0, FLOPs (B)=1.2, Extra Data Aug.=None, Input size=224x2242021.12 | 78.7 | 0.14 | |
| ResNet-50Elite setting=true, FLOPs (G)=4.1, Batch Time (ms)=34.2, Batch size=322021.04 | 78.7 | — | |
| HRNet-W32#Param.=41.2M, FLOPs=8.3G, Input size=224x2242022.04 | 78.5 | — | |
| ResNet152#Param.=60.2M, FLOPs=11.6G, Input size=224x2242022.04 | 78.3 | — | |
| SReT w/ KDNetwork=SReT-LT, Epochs=300, #Params (M)=5.0, FLOPs (B)=1.2, Extra Data Aug.=MixUp+CutMix+RA, Input size=224x2242021.12 | 77.7 | 1 | |
| SReT w/o KDNetwork=SReT-LT, Epochs=300, #Params (M)=5.0, FLOPs (B)=1.2, Extra Data Aug.=MixUp+CutMix+RA, Input size=224x2242021.12 | 76.7 | — | |
| MLP-Mixer-B/16Input resolution=224^2, # Params (M)=792022.01 | 76.4 | — | |
| NVIT-T#FLOPs=1.3G, Speedup=4.66x2021.10 | 76.21 | — | |
| ResNet50#Param.=25.6M, FLOPs=4.1G, Input size=224x2242022.04 | 76.1 | — | |
| AutoFormer-T#FLOPs=1.3G, Speedup=4.59x2021.10 | 75.7 | — | |
| ViT w/ FKDNetwork=ViT-T, Epochs=300, #Params (M)=5.7, FLOPs (B)=1.3, Extra Data Aug.=None, Input size=224x2242021.12 | 75.2 | 0.15 | |
| DeiT w/ KDNetwork=ViT-T, Epochs=300, #Params (M)=5.7, FLOPs (B)=1.3, Extra Data Aug.=MixUp+CutMix+RA, Input size=224x2242021.12 | 74.5 | 1 | |
| DeiT w/o KDNetwork=ViT-T, Epochs=300, #Params (M)=5.7, FLOPs (B)=1.3, Extra Data Aug.=MixUp+CutMix+RA, Input size=224x2242021.12 | 72.2 | — | |
| ViT (Vanilla)Network=ViT-T, Epochs=300, #Params (M)=5.7, FLOPs (B)=1.3, Extra Data Aug.=None, Input size=224x2242021.12 | 68.7 | — |