Image Classification on ImageNet 1K (val) (Top-1, Top-5)
76.16Top-1 AccTeacher (ResNet50)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Teacher (ResNet50)Role=Teacher, Backbone=ResNet502023.04 | 76.16 | 92.86 | |
| ReviewKDDistillation Category=Features, Teacher=ResNet50, Student=MobileNet2023.04 | 72.56 | 91 | |
| CAT-KDDistillation Category=Attention, Teacher=ResNet50, Student=MobileNet2023.04 | 72.24 | 91.13 | |
| DKDDistillation Category=Logits, Teacher=ResNet50, Student=MobileNet2023.04 | 72.05 | 91.05 | |
| CRDDistillation Category=Features, Teacher=ResNet50, Student=MobileNet2023.04 | 71.37 | 90.41 | |
| OFDDistillation Category=Features, Teacher=ResNet50, Student=MobileNet2023.04 | 71.25 | 90.34 | |
| ATDistillation Category=Attention, Teacher=ResNet50, Student=MobileNet2023.04 | 69.56 | 89.33 | |
| Student (MobileNet)Role=Student, Backbone=MobileNet2023.04 | 68.87 | 88.76 | |
| KDDistillation Category=Logits, Teacher=ResNet50, Student=MobileNet2023.04 | 68.58 | 88.98 |