Image Classification on ImageNet-1k 1.0 (test val)
86.5Top-1 AccTinyViT-21M 512
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TinyViT-21M 512#Params (M)=21, MACs (G)=27.0, Throughput (images/s)=167, Input=512, Arch.=Hybrid, Pre-training=IN-21k with fast distillation, Fine-tuning=higher resolution2022.07 | 86.5 | 97.9 | |
| TinyViT-21M 384#Params (M)=21, MACs (G)=13.8, Throughput (images/s)=394, Input=384, Arch.=Hybrid, Pre-training=IN-21k with fast distillation, Fine-tuning=higher resolution2022.07 | 86.2 | 97.8 | |
| TinyViT-21M#Params (M)=21, MACs (G)=4.3, Throughput (images/s)=1571, Input=224, Arch.=Hybrid, Pre-training=IN-21k with fast distillation2022.07 | 84.8 | 97.3 | |
| EffNet-B5#Params (M)=30, MACs (G)=9.9, Throughput (images/s)=330, Input=456, Arch.=CNN2022.07 | 83.6 | 96.7 | |
| TinyViT-11M#Params (M)=11, MACs (G)=2.0, Throughput (images/s)=2468, Input=224, Arch.=Hybrid, Pre-training=IN-21k with fast distillation2022.07 | 83.2 | 96.5 | |
| TinyViT-21M#Params (M)=21, MACs (G)=4.3, Throughput (images/s)=1571, Input=224, Arch.=Hybrid2022.07 | 83.1 | 96.5 | |
| CrossViT-15#Params (M)=28, MACs (G)=6.1, Throughput (images/s)=1306, Input=224, Arch.=Trans2022.07 | 82.3 | — | |
| CoaT-Lite Small#Params (M)=20, MACs (G)=4.0, Throughput (images/s)=1138, Input=224, Arch.=Trans2022.07 | 81.9 | 95.6 | |
| AutoFormer-S#Params (M)=23, MACs (G)=5.1, Throughput (images/s)=1341, Input=224, Arch.=Trans2022.07 | 81.7 | 95.7 | |
| LeViT-256#Params (M)=19, MACs (G)=1.1, Throughput (images/s)=7386, Input=224, Arch.=Hybrid2022.07 | 81.6 | — | |
| TinyViT-11M#Params (M)=11, MACs (G)=2.0, Throughput (images/s)=2468, Input=224, Arch.=Hybrid2022.07 | 81.5 | 95.8 | |
| T2T-ViT-14#Params (M)=21, MACs (G)=4.8, Throughput (images/s)=1557, Input=224, Arch.=Trans2022.07 | 81.5 | 95.7 | |
| Swin-T#Params (M)=28, MACs (G)=4.5, Throughput (images/s)=1393, Input=224, Arch.=Trans2022.07 | 81.2 | 95.5 | |
| TinyViT-5M#Params (M)=5.4, MACs (G)=1.3, Throughput (images/s)=3060, Input=224, Arch.=Hybrid, Pre-training=IN-21k with fast distillation2022.07 | 80.7 | 95.6 | |
| DeiT-S#Params (M)=22, MACs (G)=4.6, Throughput (images/s)=2276, Input=224, Arch.=Trans2022.07 | 79.9 | 95 | |
| ResT-Small#Params (M)=14, MACs (G)=2.1, Throughput (images/s)=2037, Input=224, Arch.=Trans2022.07 | 79.6 | 94.9 | |
| TinyViT-5M#Params (M)=5.4, MACs (G)=1.3, Throughput (images/s)=3060, Input=224, Arch.=Hybrid2022.07 | 79.1 | 94.8 | |
| MobileViT-S#Params (M)=6, MACs (G)=1.8, Throughput (images/s)=2661, Input=256, Arch.=Hybrid2022.07 | 78.4 | — | |
| CrossViT-9#Params (M)=9, MACs (G)=2.0, Throughput (images/s)=2659, Input=224, Arch.=Trans2022.07 | 77.1 | 92.4 | |
| Mobile-Former-214M#Params (M)=9, MACs (G)=0.2, Throughput (images/s)=3105, Input=224, Arch.=Hybrid2022.07 | 76.7 | — | |
| GLiT-Tiny#Params (M)=7, MACs (G)=1.5, Throughput (images/s)=3262, Input=224, Arch.=Trans2022.07 | 76.3 | — | |
| VITAS-DeiT-A#Params (M)=6, MACs (G)=1.3, Throughput (images/s)=3504, Input=224, Arch.=Trans2022.07 | 75.5 | 92.4 | |
| PVT-Tiny#Params (M)=13, MACs (G)=1.9, Throughput (images/s)=2791, Input=224, Arch.=Trans2022.07 | 75.1 | — | |
| ResNet-18#Params (M)=12, MACs (G)=1.8, Throughput (images/s)=8714, Input=224, Arch.=CNN2022.07 | 70.3 | 86.7 |