Image Classification on ImageNet-1K (Top-1 Accuracy, Teacher Metrics)
77.3Top-1 AccuracyPLD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PLDStudent architecture=ResNet-50, Teacher architecture=ResNet-152(60.19M), Student Params(M)=25.562025.06 | 77.3 | 79.61 | 0.7 | 0.5 | |
| KDStudent architecture=ResNet-50, Teacher architecture=ResNet-152(60.19M), Student Params(M)=25.562025.06 | 76.8 | 79.61 | — | — | |
| DISTStudent architecture=ResNet-50, Teacher architecture=ResNet-152(60.19M), Student Params(M)=25.562025.06 | 76.6 | 79.61 | — | — | |
| PLDStudent architecture=MobileNet-v4 Hybrid-Medium, Teacher architecture=Large (conv) (32.59M), Student Params(M)=11.072025.06 | 76.33 | 80.83 | 0.35 | 0.86 | |
| DISTStudent architecture=MobileNet-v4 Hybrid-Medium, Teacher architecture=Large (conv) (32.59M), Student Params(M)=11.072025.06 | 75.98 | 80.83 | — | — | |
| PLDStudent architecture=MobileNet-v4 Medium (conv), Teacher architecture=Large (conv) (32.59M), Student Params(M)=9.722025.06 | 75.72 | 80.83 | 0.32 | 0.86 | |
| PLDStudent architecture=ViT-Small, Teacher architecture=ViT-Large(304.33M), Student Params(M)=22.052025.06 | 75.63 | 84.8 | 0.72 | 0.3 | |
| KDStudent architecture=MobileNet-v4 Hybrid-Medium, Teacher architecture=Large (conv) (32.59M), Student Params(M)=11.072025.06 | 75.47 | 80.83 | — | — | |
| DISTStudent architecture=MobileNet-v4 Medium (conv), Teacher architecture=Large (conv) (32.59M), Student Params(M)=9.722025.06 | 75.4 | 80.83 | — | — | |
| KDStudent architecture=ViT-Small, Teacher architecture=ViT-Large(304.33M), Student Params(M)=22.052025.06 | 75.33 | 84.8 | — | — | |
| DISTStudent architecture=ViT-Small, Teacher architecture=ViT-Large(304.33M), Student Params(M)=22.052025.06 | 74.91 | 84.8 | — | — | |
| KDStudent architecture=MobileNet-v4 Medium (conv), Teacher architecture=Large (conv) (32.59M), Student Params(M)=9.722025.06 | 74.86 | 80.83 | — | — | |
| PLDStudent architecture=MobileNet-v4 Small (conv), Teacher architecture=Large (conv) (32.59M), Student Params(M)=3.772025.06 | 70.07 | 80.83 | 0.02 | 2.69 | |
| DISTStudent architecture=MobileNet-v4 Small (conv), Teacher architecture=Large (conv) (32.59M), Student Params(M)=3.772025.06 | 70.05 | 80.83 | — | — | |
| KDStudent architecture=MobileNet-v4 Small (conv), Teacher architecture=Large (conv) (32.59M), Student Params(M)=3.772025.06 | 67.38 | 80.83 | — | — |