Image Classification on ImageNet-1K (KD/DIST/PLD Accuracy)
84.8Top-1 Accuracy (Teacher)ViT-Large/16
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ViT-Large/16Role=Teacher baseline, Teacher Params (M)=304.332025.06 | 84.8 | — | — | — | — | — | |
| ViT-Base/16Role=Teacher baseline, Teacher Params (M)=86.572025.06 | 82.07 | — | — | — | — | — | |
| MobileNet-v4 Conv LargeRole=Teacher baseline, Teacher Params (M)=32.592025.06 | 80.83 | — | — | — | — | — | |
| ResNet-152Role=Teacher baseline, Teacher Params (M)=60.192025.06 | 79.61 | — | — | — | — | — | |
| MobileNet-v4 Hybrid MediumRole=Teacher baseline, Teacher Params (M)=11.072025.06 | 78.66 | — | — | — | — | — | |
| DISTStudent=ResNet-50, Teacher=ResNet-152, Teacher Params (M)=60.192025.06 | — | — | 76.6 | — | — | — | |
| DISTStudent=ResNet-50, Teacher=MobileNet-v4 Hybrid Medium, Teacher Params (M)=11.072025.06 | — | — | 77 | — | — | — | |
| DISTStudent=ResNet-50, Teacher=MobileNet-v4 Conv Large, Teacher Params (M)=32.592025.06 | — | — | 75.05 | — | — | — | |
| DISTStudent=ResNet-50, Teacher=ViT-Base/16, Teacher Params (M)=86.572025.06 | — | — | 75.4 | — | — | — | |
| DISTStudent=ResNet-50, Teacher=ViT-Large/16, Teacher Params (M)=304.332025.06 | — | — | 76.86 | — | — | — | |
| KDStudent=ResNet-50, Teacher=ResNet-152, Teacher Params (M)=60.192025.06 | — | 76.8 | — | — | — | — | |
| KDStudent=ResNet-50, Teacher=MobileNet-v4 Hybrid Medium, Teacher Params (M)=11.072025.06 | — | 76.85 | — | — | — | — | |
| KDStudent=ResNet-50, Teacher=MobileNet-v4 Conv Large, Teacher Params (M)=32.592025.06 | — | 73.98 | — | — | — | — | |
| KDStudent=ResNet-50, Teacher=ViT-Base/16, Teacher Params (M)=86.572025.06 | — | 74.27 | — | — | — | — | |
| KDStudent=ResNet-50, Teacher=ViT-Large/16, Teacher Params (M)=304.332025.06 | — | 75.98 | — | — | — | — | |
| PLDStudent=ResNet-50, Teacher=ResNet-152, Teacher Params (M)=60.192025.06 | — | — | — | 77.3 | 0.7 | 0.5 | |
| PLDStudent=ResNet-50, Teacher=MobileNet-v4 Hybrid Medium, Teacher Params (M)=11.072025.06 | — | — | — | 77.34 | 0.34 | 0.49 | |
| PLDStudent=ResNet-50, Teacher=MobileNet-v4 Conv Large, Teacher Params (M)=32.592025.06 | — | — | — | 75.53 | 0.48 | 1.55 | |
| PLDStudent=ResNet-50, Teacher=ViT-Base/16, Teacher Params (M)=86.572025.06 | — | — | — | 75.8 | 0.4 | 1.53 | |
| PLDStudent=ResNet-50, Teacher=ViT-Large/16, Teacher Params (M)=304.332025.06 | — | — | — | 77.38 | 0.52 | 1.4 |