Image Classification on ImageNet 1k (test val) (Efficiency & Latency Profile)
83.6Top-1 AccuracyEfficientNet-B5
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| EfficientNet-B5Type=CONV, Params(M)=30, GMACS=9.9, Train. Epoch=3502022.06 | 83.6 | — | — | — | 23 | — | — | — | — | — | — | |
| EfficientFormer-L7Type=MetaBlock, Params(M)=82.1, GMACS=10.2, Train. Epoch=3002022.06 | 83.3 | — | — | — | 7 | — | — | — | — | — | — | |
| CSwin-TType=Attention, Params(M)=23, GMACS=4.3, Train. Epoch=3002022.06 | 82.7 | — | — | — | 28.7 | — | — | — | — | — | — | |
| DeiT-SType=Attention, Params(M)=22.5, GMACS=4.5, Train. Epoch=10002022.06 | 82.6 | — | — | — | 11.8 | — | — | — | — | — | — | |
| EfficientFormer-L3Type=MetaBlock, Params(M)=31.3, GMACS=3.9, Train. Epoch=3002022.06 | 82.4 | — | — | — | 3 | — | — | — | — | — | — | |
| NASVIT-A5Type=Hybrid, GMACS=0.76, Train. Epoch=3602022.06 | 81.8 | — | — | — | — | — | — | — | — | — | — | |
| EfficientNet-B3Type=CONV, Params(M)=12, GMACS=1.8, Train. Epoch=3502022.06 | 81.6 | — | — | — | 6.6 | — | — | — | — | — | — | |
| LeViT-256Type=Hybrid, Params(M)=18.9, GMACS=1.1, Train. Epoch=1000, Latency Note=Measured with GeLU activation2022.06 | 81.6 | — | — | — | 11.9 | — | — | — | — | — | — | |
| T2T-ViT-14Type=Attention, Params(M)=21.5, GMACS=4.8, Train. Epoch=3102022.06 | 81.5 | — | — | — | 21 | — | — | — | — | — | — | |
| PoolFormer-s36Type=Pool, Params(M)=31, GMACS=5.2, Train. Epoch=3002022.06 | 81.4 | — | — | — | 6.7 | — | — | — | — | — | — | |
| Swin-TinyType=Attention, Params(M)=29, GMACS=4.5, Train. Epoch=3002022.06 | 81.3 | — | — | — | 22 | — | — | — | — | — | — | |
| DeiT-SType=Attention, Params(M)=22.5, GMACS=4.5, Train. Epoch=3002022.06 | 81.2 | — | — | — | 11.8 | — | — | — | — | — | — | |
| PoolFormer-s24Type=Pool, Params(M)=21, GMACS=3.6, Train. Epoch=3002022.06 | 80.3 | — | — | — | 6.2 | — | — | — | — | — | — | |
| Convmixer-768Type=Hybrid, Params(M)=21.1, GMACS=20.7, Train. Epoch=3002022.06 | 80.2 | — | — | — | 11.6 | — | — | — | — | — | — | |
| EfficientFormer-L1Type=MetaBlock, Params(M)=12.3, GMACS=1.3, Train. Epoch=10002022.06 | 80.2 | — | — | — | 1.6 | — | — | — | — | — | — | |
| PVT-SmallType=Attention, Params(M)=24.5, GMACS=3.8, Train. Epoch=3002022.06 | 79.8 | — | — | — | 24.4 | — | — | — | — | — | — | |
| ResMLP-S24Type=SMLP, Params(M)=30, GMACS=6, Train. Epoch=3002022.06 | 79.4 | — | — | — | 7.6 | — | — | — | — | — | — | |
| MobileFormer-508MType=Hybrid, Params(M)=14, GMACS=0.51, Train. Epoch=4502022.06 | 79.3 | — | — | — | 13.2 | — | — | — | — | — | — | |
| EfficientFormer-L1Type=MetaBlock, Params(M)=12.3, GMACS=1.3, Train. Epoch=3002022.06 | 79.2 | — | — | — | 1.6 | — | — | — | — | — | — | |
| SplitNetsBackbone=F2022.04 | 78.91 | — | — | — | 1.55 | — | 1.11 | — | — | 0.94 | 3.59 | |
| SplitNetsBackbone=E2022.04 | 78.56 | — | — | — | 1.71 | — | 0.16 | — | — | 0.84 | 2.71 | |
| ResNet50Type=CONV, Params(M)=25.5, GMACS=4.1, Train. Epoch=3002022.06 | 78.5 | — | — | — | 3 | — | — | — | — | — | — | |
| All-on-sen.HW Constraints=Mem_sen <= 2MB, Backbone=RegNetX-3.2GF2022.04 | 78.36 | — | — | — | 25.4 | 0 | 0 | 0 | 0 | 0 | 25.4 | |
| All-on-sen.HW Constraints=Mem_sen <= 2MB, Backbone=ResNet-1522022.04 | 78.31 | — | — | — | 92.1 | 0 | 0 | 0 | 0 | 0 | 92.1 | |
| SplitNetsBackbone=D2022.04 | 77.42 | — | — | — | 1.1 | — | 0.13 | — | — | 0.66 | 1.88 | |
| PoolFormer-s12Type=Pool, Params(M)=12, GMACS=2, Train. Epoch=3002022.06 | 77.2 | — | — | — | 6.1 | — | — | — | — | — | — | |
| All-on-sen.HW Constraints=Mem_sen <= 2MB, Backbone=EfficientNet-B02022.04 | 77.13 | — | — | — | 3.09 | 0 | 0 | 0 | 0 | 0 | 3.09 | |
| EfficientNet-B0Type=CONV, Params(M)=5.3, GMACS=0.4, Train. Epoch=3502022.06 | 77.1 | — | — | — | 2.7 | — | — | — | — | — | — | |
| SplitNetsBackbone=C2022.04 | 76.98 | — | — | — | 0.79 | — | 0.13 | — | — | 0.58 | 1.49 | |
| DeiT-TType=Attention, Params(M)=5.9, GMACS=1.2, Train. Epoch=10002022.06 | 76.6 | — | — | — | 9.2 | — | — | — | — | — | — | |
| Head DistillBackbone=ResNet-152+2022.04 | 75.13 | — | — | — | 1 | — | 0.27 | — | — | 9.45 | 10.72 | |
| MobileViT-XSType=Hybrid, Params(M)=2.3, GMACS=0.7, Train. Epoch=3002022.06 | 74.8 | — | — | — | 7.2 | — | — | — | — | — | — | |
| MobileNetV2x1.4Type=CONV, Params(M)=6.1, GMACS=0.6, Train. Epoch=3002022.06 | 74.7 | — | — | — | 1.6 | — | — | — | — | — | — | |
| DeiT-TType=Attention, Params(M)=5.9, GMACS=1.2, Train. Epoch=3002022.06 | 74.5 | — | — | — | 9.2 | — | — | — | — | — | — | |
| All-on-sen.HW Constraints=Mem_sen <= 2MB, Backbone=MNASNet-1.02022.04 | 73.46 | — | — | — | 2.52 | 0 | 0 | 0 | 0 | 0 | 2.52 | |
| NeurosurgeonHW Constraints=BW_comm = 37.5 MB/s, Backbone=MNASNet-1.02022.04 | 73.46 | — | — | — | 0.83 | — | 0.84 | — | — | 0.17 | 1.82 | |
| SplitNetsBackbone=B2022.04 | 73.45 | — | — | — | 0.56 | — | 0.07 | — | — | 0.32 | 0.95 | |
| SplitNetsBackbone=A2022.04 | 73.15 | — | — | — | 0.51 | — | 0.07 | — | — | 0.3 | 0.88 | |
| All-on-sen.HW Constraints=Mem_sen <= 2MB, Backbone=MobileNet-v22022.04 | 71.88 | — | — | — | 2.46 | 0 | 0 | 0 | 0 | 0 | 2.46 | |
| All-on-agg.HW Constraints=Comp_sen (16nm) = 125 GOP/s, Backbone=MobileNet-v22022.04 | 71.88 | 0 | 0 | 0 | 0 | — | 4.01 | — | — | 0.24 | 4.25 | |
| MobileNetV2x1.0Type=CONV, Params(M)=3.5, GMACS=0.3, Train. Epoch=3002022.06 | 71.8 | — | — | — | 1.3 | — | — | — | — | — | — |