Image Classification on ImageNet 1k (OTS Acc., Trained Acc.)
86.9Trained AccuracyViT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ViTType=merge, Backbone=MAE-H, Flops=167.4, Train speed up=false2024.05 | 86.9 | 86.9 | |
| PiToMeType=merge, Backbone=MAE-H, Flops=92.8, Train speed up=true2024.05 | 86.7 | 86.4 | |
| DiffRateType=merge, Backbone=MAE-H, Flops=92.8, Train speed up=true2024.05 | 86.6 | 85.9 | |
| ToMeType=merge, Backbone=MAE-H, Flops=92.8, Train speed up=true2024.05 | 86.4 | 85.6 | |
| ToFuType=merge, Backbone=MAE-H, Flops=92.8, Train speed up=true2024.05 | 86.4 | 85.8 | |
| DCTType=merge, Backbone=MAE-H, Flops=92.8, Train speed up=true2024.05 | 86 | 84.3 | |
| ViTType=merge, Backbone=MAE-L, Flops=61.6, Train speed up=false2024.05 | 85.7 | 85.7 | |
| MViTv2-LType=Other, Flops=42.1, Train speed up=false2024.05 | 85.3 | — | |
| DiffRateType=merge, Backbone=MAE-L, Flops=31.0, Train speed up=true2024.05 | 85.3 | 83.2 | |
| PiToMeType=merge, Backbone=MAE-L, Flops=31.0, Train speed up=true2024.05 | 85.3 | 84.6 | |
| ToFuType=merge, Backbone=MAE-L, Flops=31.0, Train speed up=true2024.05 | 85.1 | 83.8 | |
| ToMeType=merge, Backbone=MAE-L, Flops=31.0, Train speed up=true2024.05 | 85 | 82.9 | |
| MViTv2-BType=Other, Flops=10.2, Train speed up=false2024.05 | 84.4 | — | |
| DCTType=merge, Backbone=MAE-L, Flops=31.0, Train speed up=true2024.05 | 84.4 | 82.8 | |
| CSWin-BType=Other, Flops=15.0, Train speed up=false2024.05 | 84.2 | — | |
| Swin-BType=Other, Flops=15.4, Train speed up=false2024.05 | 84 | — | |
| PiToMeType=merge, Backbone=DeiT-S, Flops=2.9, Train speed up=true2024.05 | 79.8 | 79.1 | |
| ViTType=merge, Backbone=DeiT-S, Flops=4.6, Train speed up=false2024.05 | 79.8 | 79.8 | |
| ToFuType=merge, Backbone=DeiT-S, Flops=2.9, Train speed up=true2024.05 | 79.6 | 77.8 | |
| E-ViTType=prune, Backbone=DeiT-S, Flops=2.9, Train speed up=false2024.05 | 79.5 | — | |
| DiffRateType=merge, Backbone=DeiT-S, Flops=2.9, Train speed up=true2024.05 | 79.5 | 76.8 | |
| ToMeType=merge, Backbone=DeiT-S, Flops=2.9, Train speed up=true2024.05 | 79.4 | 77.7 | |
| Dynamic-ViTType=prune, Backbone=DeiT-S, Flops=2.9, Train speed up=false2024.05 | 79.3 | — | |
| SP-ViTType=prune, Backbone=DeiT-S, Flops=2.6, Train speed up=false2024.05 | 79.3 | — | |
| A-ViTType=prune, Backbone=DeiT-S, Flops=2.9, Train speed up=false2024.05 | 78.6 | — | |
| DCTType=merge, Backbone=DeiT-S, Flops=2.9, Train speed up=true2024.05 | 78.6 | 74.8 | |
| ViTType=merge, Backbone=DeiT-T, Flops=1.2, Train speed up=false2024.05 | 72.3 | 72.3 | |
| PiToMeType=merge, Backbone=DeiT-T, Flops=0.79, Train speed up=true2024.05 | 71.6 | 70.8 | |
| DiffRateType=merge, Backbone=DeiT-T, Flops=0.79, Train speed up=true2024.05 | 70.7 | 69.9 | |
| ToFuType=merge, Backbone=DeiT-T, Flops=0.79, Train speed up=true2024.05 | 70.5 | 69.6 | |
| ToMeType=merge, Backbone=DeiT-T, Flops=0.79, Train speed up=true2024.05 | 70 | 68.9 | |
| DCTType=merge, Backbone=DeiT-T, Flops=0.79, Train speed up=true2024.05 | 68.7 | 67.6 |