Image Classification on ImageNet (val) (Accuracy and Training Speed)
72.84Top-1 AccIKL-KD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| IKL-KDDistillation Manner=Logits, Teacher=ResNet50, Student=MobileNet, Extra Parameters=false2023.05 | 72.84 | 0.252 | |
| ReviewKDDistillation Manner=Features, Teacher=ResNet50, Student=MobileNet, Extra Parameters=true2023.05 | 72.56 | 0.526 | |
| DKDDistillation Manner=Logits, Teacher=ResNet50, Student=MobileNet, Extra Parameters=false2023.05 | 72.05 | — | |
| IKL-KDDistillation Manner=Logits, Teacher=ResNet34, Student=ResNet18, Extra Parameters=false2023.05 | 71.91 | 0.197 | |
| DKDDistillation Manner=Logits, Teacher=ResNet34, Student=ResNet18, Extra Parameters=false2023.05 | 71.7 | — | |
| ReviewKDDistillation Manner=Features, Teacher=ResNet34, Student=ResNet18, Extra Parameters=true2023.05 | 71.61 | 0.319 | |
| CRDDistillation Manner=Features, Teacher=ResNet50, Student=MobileNet, Extra Parameters=true2023.05 | 71.37 | — | |
| OFDDistillation Manner=Features, Teacher=ResNet50, Student=MobileNet, Extra Parameters=true2023.05 | 71.25 | — | |
| CRDDistillation Manner=Features, Teacher=ResNet34, Student=ResNet18, Extra Parameters=true2023.05 | 71.17 | — | |
| KDDistillation Manner=Logits, Teacher=ResNet34, Student=ResNet18, Extra Parameters=false2023.05 | 71.03 | — | |
| OFDDistillation Manner=Features, Teacher=ResNet34, Student=ResNet18, Extra Parameters=true2023.05 | 70.81 | — | |
| ATDistillation Manner=Features, Teacher=ResNet34, Student=ResNet18, Extra Parameters=false2023.05 | 70.69 | — | |
| KDDistillation Manner=Logits, Teacher=ResNet50, Student=MobileNet, Extra Parameters=false2023.05 | 70.5 | — | |
| ATDistillation Manner=Features, Teacher=ResNet50, Student=MobileNet, Extra Parameters=false2023.05 | 69.56 | — |