Image Classification on CIFAR-100 (Stu. and Delta Metrics)
79.11Student AccuracySFTN-4
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SFTN-4Teacher=resnet32x4, Student=ShuffleV1, Training Epochs=240 x 42021.02 | 79.11 | 7.16 | |
| SFTN-4Teacher=resnet32x4, Student=ShuffleV2, Training Epochs=240 x 42021.02 | 78.95 | 5.74 | |
| SFTNTeacher=resnet32x4, Student=ShuffleV22021.02 | 78.07 | 4.86 | |
| SFTNTeacher=resnet32x4, Student=ShuffleV12021.02 | 77.93 | 5.98 | |
| RCOTeacher=resnet32x4, Student=ShuffleV22021.02 | 77.4 | 4.19 | |
| RCO-EEI-4Teacher=resnet32x4, Student=ShuffleV1, Training Epochs=240 x 42021.02 | 76.97 | 5.02 | |
| SFTN-4Teacher=WRN40-2, Student=WRN16-2, Training Epochs=240 x 42021.02 | 76.96 | 3.55 | |
| RCO-EEI-4Teacher=resnet32x4, Student=ShuffleV2, Training Epochs=240 x 42021.02 | 76.89 | 3.68 | |
| SFTN-4Teacher=resnet32x4, Student=resnet8x4, Training Epochs=240 x 42021.02 | 76.67 | 4.29 | |
| RCOTeacher=resnet32x4, Student=ShuffleV12021.02 | 76.62 | 4.67 | |
| SFTN-4Teacher=WRN40-2, Student=WRN40-1, Training Epochs=240 x 42021.02 | 76.31 | 4.15 | |
| SFTNTeacher=WRN40-2, Student=WRN16-22021.02 | 76.25 | 2.84 | |
| SFTNTeacher=resnet32x4, Student=resnet8x42021.02 | 76.09 | 3.71 | |
| RCO-EEI-4Teacher=WRN40-2, Student=WRN16-2, Training Epochs=240 x 42021.02 | 75.69 | 2.28 | |
| SFTN-4Teacher=ResNet50, Student=VGG8, Training Epochs=240 x 42021.02 | 75.52 | 4.4 | |
| StandardTeacher=WRN40-2, Student=WRN16-22021.02 | 75.46 | 2.05 | |
| KDCLTeacher=WRN40-2, Student=WRN16-22021.02 | 75.45 | 2.04 | |
| RCOTeacher=WRN40-2, Student=WRN16-22021.02 | 75.36 | 1.95 | |
| DMLTeacher=WRN40-2, Student=WRN16-22021.02 | 75.3 | 1.89 | |
| StandardTeacher=resnet32x4, Student=ShuffleV22021.02 | 75.25 | 2.04 | |
| KDCLTeacher=resnet32x4, Student=resnet8x42021.02 | 75.21 | 2.83 | |
| SFTNTeacher=WRN40-2, Student=WRN40-12021.02 | 75.09 | 2.93 | |
| SFTNTeacher=ResNet50, Student=VGG82021.02 | 74.92 | 3.8 | |
| RCO-EEI-4Teacher=WRN40-2, Student=WRN40-1, Training Epochs=240 x 42021.02 | 74.87 | 2.71 | |
| KDCLTeacher=WRN40-2, Student=WRN40-12021.02 | 74.65 | 2.49 | |
| DMLTeacher=resnet32x4, Student=resnet8x42021.02 | 74.34 | 1.96 | |
| KDCLTeacher=resnet32x4, Student=ShuffleV22021.02 | 74.3 | 1.09 | |
| RCOTeacher=ResNet50, Student=VGG82021.02 | 74.3 | 3.18 | |
| RCOTeacher=WRN40-2, Student=WRN40-12021.02 | 74.29 | 2.13 | |
| StandardTeacher=resnet32x4, Student=ShuffleV12021.02 | 74.26 | 2.31 | |
| RCO-EEI-4Teacher=ResNet50, Student=VGG8, Training Epochs=240 x 42021.02 | 74.24 | 3.12 | |
| DMLTeacher=WRN40-2, Student=WRN40-12021.02 | 74.08 | 1.92 | |
| RCOTeacher=resnet32x4, Student=resnet8x42021.02 | 74.06 | 1.68 | |
| KDCLTeacher=resnet32x4, Student=ShuffleV12021.02 | 73.98 | 2.03 | |
| StandardTeacher=ResNet50, Student=VGG82021.02 | 73.82 | 2.7 | |
| DMLTeacher=resnet32x4, Student=ShuffleV22021.02 | 73.8 | 0.59 | |
| StandardTeacher=WRN40-2, Student=WRN40-12021.02 | 73.73 | 1.57 | |
| RCO-EEI-4Teacher=resnet32x4, Student=resnet8x4, Training Epochs=240 x 42021.02 | 73.73 | 1.35 | |
| KDCLTeacher=ResNet50, Student=VGG82021.02 | 73.48 | 2.36 | |
| StandardTeacher=resnet32x4, Student=resnet8x42021.02 | 73.39 | 1.01 | |
| DMLTeacher=resnet32x4, Student=ShuffleV12021.02 | 73.37 | 1.42 | |
| DMLTeacher=ResNet50, Student=VGG82021.02 | 73.01 | 1.89 |