Image Classification on ImageNet-1k (val) (Top-1 Accuracy, FLOPs, and Throughput)
2.6FLOPs (G)SPVIT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SPVITBackbone Model=ViT-S (DeiT)2023.05 | 2.6 | 79.34 | — | |
| DynamicViTBackbone Model=ViT-S (DeiT)2023.05 | 2.9 | 79.3 | 6,527 | |
| ToMeBackbone Model=ViT-S (DeiT)2023.05 | 2.9 | 79.49 | 6,712 | |
| ATSBackbone Model=ViT-S (DeiT)2023.05 | 2.9 | 79.7 | — | |
| DiffRateBackbone Model=ViT-S (DeiT), Fine-tuning Protocol=None2023.05 | 2.9 | 79.58 | 6,744 | |
| DiffRateBackbone Model=ViT-S (DeiT), Fine-tuning Protocol=30 epochs2023.05 | 2.9 | 79.83 | 6,744 | |
| Evo-ViTBackbone Model=ViT-S (DeiT)2023.05 | 3 | 79.4 | 6,679 | |
| EVITBackbone Model=ViT-S (DeiT)2023.05 | 3 | 79.5 | 6,807 | |
| BaselineBackbone Model=ViT-S (DeiT)2023.05 | 4.6 | 79.82 | 5,039 | |
| EVITBackbone Model=ViT-B (DeiT)2023.05 | 11.5 | 81.3 | 2,886 | |
| ToMeBackbone Model=ViT-B (DeiT)2023.05 | 11.5 | 81.41 | 2,834 | |
| DiffRateBackbone Model=ViT-B (DeiT), Fine-tuning Protocol=None2023.05 | 11.5 | 81.5 | 2,865 | |
| DiffRateBackbone Model=ViT-B (DeiT), Fine-tuning Protocol=30 epochs2023.05 | 11.5 | 81.71 | 2,865 | |
| ToMeBackbone Model=ViT-B (MAE)2023.05 | 11.5 | 82.94 | 2,834 | |
| DiffRateBackbone Model=ViT-B (MAE), Fine-tuning Protocol=None2023.05 | 11.5 | 82.91 | 2,865 | |
| DiffRateBackbone Model=ViT-B (MAE), Fine-tuning Protocol=30 epochs2023.05 | 11.5 | 83.25 | 2,865 | |
| BaselineBackbone Model=ViT-B (DeiT)2023.05 | 17.6 | 81.83 | 2,130 | |
| BaselineBackbone Model=ViT-B (MAE)2023.05 | 17.6 | 83.72 | 2,130 | |
| ToMeBackbone Model=ViT-L (MAE)2023.05 | 42.3 | 85.59 | 1,033 | |
| DiffRateBackbone Model=ViT-L (MAE), Fine-tuning Protocol=None2023.05 | 42.3 | 85.56 | 1,045 | |
| DiffRateBackbone Model=ViT-L (MAE), Fine-tuning Protocol=30 epochs2023.05 | 42.3 | 85.71 | 1,045 | |
| BaselineBackbone Model=ViT-L (MAE)2023.05 | 61.6 | 85.95 | 758 | |
| ToMeBackbone Model=ViT-H (MAE)2023.05 | 103.4 | 86.51 | 442 | |
| DiffRateBackbone Model=ViT-H (MAE), Fine-tuning Protocol=None2023.05 | 103.4 | 86.72 | 450 | |
| BaselineBackbone Model=ViT-H (MAE)2023.05 | 167.4 | 86.88 | 299 |