Image Classification on ImageNet 1k (val) (Standard Top-1 & Top-5 Accuracy)
76.16Top-1 AccTeacher Baseline
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Teacher BaselineArchitecture=ResNet-50, Training Strategy=B12026.02 | 76.16 | 92.86 | |
| DSKDTeacher=ResNet-50, Student=MobileNetV1, Training Strategy=B12026.02 | 73.73 | 91.52 | |
| Teacher BaselineArchitecture=ResNet-34, Training Strategy=B12026.02 | 73.31 | 91.42 | |
| DiffKDTeacher=ResNet-50, Student=MobileNetV1, Training Strategy=B12026.02 | 73.27 | 91.14 | |
| IKDTeacher=ResNet-50, Student=MobileNetV1, Training Strategy=B12026.02 | 73.27 | 91.34 | |
| CTKDTeacher=ResNet-50, Student=MobileNetV1, Training Strategy=B12026.02 | 72.87 | 91.29 | |
| RLDTeacher=ResNet-50, Student=MobileNetV1, Training Strategy=B12026.02 | 72.75 | 91.18 | |
| DSKDTeacher=ResNet-34, Student=ResNet-18, Training Strategy=B12026.02 | 72.57 | 90.82 | |
| ReviewTeacher=ResNet-50, Student=MobileNetV1, Training Strategy=B12026.02 | 72.56 | 91 | |
| CAT-KDTeacher=ResNet-50, Student=MobileNetV1, Training Strategy=B12026.02 | 72.24 | 91.13 | |
| SDTeacher=ResNet-50, Student=MobileNetV1, Training Strategy=B12026.02 | 72.24 | 90.71 | |
| DiffKDTeacher=ResNet-34, Student=ResNet-18, Training Strategy=B12026.02 | 72.22 | 90.64 | |
| LSTeacher=ResNet-50, Student=MobileNetV1, Training Strategy=B12026.02 | 72.18 | 90.8 | |
| DKDTeacher=ResNet-50, Student=MobileNetV1, Training Strategy=B12026.02 | 72.05 | 91.05 | |
| RLDTeacher=ResNet-34, Student=ResNet-18, Training Strategy=B12026.02 | 71.91 | 90.59 | |
| IKDTeacher=ResNet-34, Student=ResNet-18, Training Strategy=B12026.02 | 71.82 | 90.57 | |
| DKDTeacher=ResNet-34, Student=ResNet-18, Training Strategy=B12026.02 | 71.7 | 90.41 | |
| ReviewTeacher=ResNet-34, Student=ResNet-18, Training Strategy=B12026.02 | 71.61 | 90.51 | |
| SDTeacher=ResNet-34, Student=ResNet-18, Training Strategy=B12026.02 | 71.44 | 90.05 | |
| LSTeacher=ResNet-34, Student=ResNet-18, Training Strategy=B12026.02 | 71.42 | 90.29 | |
| CTKDTeacher=ResNet-34, Student=ResNet-18, Training Strategy=B12026.02 | 71.32 | 90.27 | |
| CAT-KDTeacher=ResNet-34, Student=ResNet-18, Training Strategy=B12026.02 | 71.26 | 90.45 | |
| KDTeacher=ResNet-50, Student=MobileNetV1, Training Strategy=B12026.02 | 70.68 | 90.3 | |
| KDTeacher=ResNet-34, Student=ResNet-18, Training Strategy=B12026.02 | 70.66 | 89.88 | |
| Student BaselineArchitecture=MobileNetV1, Training Strategy=B12026.02 | 70.13 | 89.49 | |
| Student BaselineArchitecture=ResNet-18, Training Strategy=B12026.02 | 69.76 | 89.08 |