Image Classification on ImageNet-1K 1.0 (val) (Accuracy and Model/Training Efficiency)
77.83AccuracySFKD
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SFKDTeacher=ConvNeXt-T, Student=Swin-N2026.07 | 77.83 | 29.8 | 11.58 | 3.12 | 20.51 | 1,097.83 | |
| OFATeacher=ConvNeXt-T, Student=Swin-N2026.07 | 77.5 | 28.19 | 13.19 | 4.73 | 22.53 | 1,427.62 | |
| FitNetTeacher=ConvNeXt-T, Student=Swin-N2026.07 | 74.81 | 11.02 | 11.94 | 3.48 | 23.54 | 1,162.92 | |
| SFKDTeacher=Swin-T, Student=ResNet182026.07 | 72.54 | 29.8 | 12.97 | 3.13 | 8.9 | 1,280.9 | |
| SFKDTeacher=DeiT-T, Student=MobileNetV22026.07 | 71.83 | 2.24 | 2.61 | 0.62 | 11.9 | 1,074.31 | |
| OFATeacher=Swin-T, Student=ResNet182026.07 | 71.76 | 4.39 | 10.12 | 0.28 | 8.7 | 1,207.91 | |
| OFATeacher=DeiT-T, Student=MobileNetV22026.07 | 71.39 | 7.14 | 2.31 | 0.32 | 11.6 | 1,070.74 | |
| FitNetTeacher=Swin-T, Student=ResNet182026.07 | 71.18 | 11.02 | 13.32 | 3.48 | 8.9 | 1,312.24 | |
| FitNetTeacher=DeiT-T, Student=MobileNetV22026.07 | 70.95 | 1.09 | 2.57 | 0.58 | 12.1 | 1,180.33 |