Image Classification on CIFAR-100 2009 (test)
80.08AccuracyDKD†
Evaluation results
| Method | Links | |
|---|---|---|
| DKD†Teacher backbone=R32x4, Student backbone=ShuffleV2, Augmentation=Pre-defined rotations2023.03 | 80.08 | |
| LogSum distillationTeacher backbone=R32x4, Student backbone=ShuffleV2, Augmentation=Pre-defined rotations2023.03 | 79.86 | |
| DKD†Teacher backbone=R32x4, Student backbone=ShuffleV1, Augmentation=Pre-defined rotations2023.03 | 79.71 | |
| CRD†Teacher backbone=R32x4, Student backbone=ShuffleV2, Augmentation=Pre-defined rotations2023.03 | 79.01 | |
| LogSum distillationTeacher backbone=R32x4, Student backbone=ShuffleV1, Augmentation=Pre-defined rotations2023.03 | 78.99 | |
| LogSum distillationTeacher backbone=WRN40-2, Student backbone=ShuffleV1, Augmentation=Pre-defined rotations2023.03 | 78.79 | |
| CRD†Teacher backbone=R32x4, Student backbone=ShuffleV1, Augmentation=Pre-defined rotations2023.03 | 78.57 | |
| CRD†Teacher backbone=WRN40-2, Student backbone=ShuffleV1, Augmentation=Pre-defined rotations2023.03 | 78.54 | |
| KD†Teacher backbone=R32x4, Student backbone=ShuffleV2, Augmentation=Pre-defined rotations2023.03 | 78.43 | |
| LogSum distillationTeacher backbone=R32x4, Student backbone=R8x4, Augmentation=Pre-defined rotations2023.03 | 78.37 | |
| KD†Teacher backbone=WRN40-2, Student backbone=ShuffleV1, Augmentation=Pre-defined rotations2023.03 | 78 | |
| DKD†Teacher backbone=WRN40-2, Student backbone=ShuffleV1, Augmentation=Pre-defined rotations2023.03 | 77.86 | |
| KD†Teacher backbone=R32x4, Student backbone=ShuffleV1, Augmentation=Pre-defined rotations2023.03 | 77.8 | |
| CRD†Teacher backbone=R32x4, Student backbone=R8x4, Augmentation=Pre-defined rotations2023.03 | 77.69 | |
| LogSum distillationTeacher backbone=WRN40-2, Student backbone=WRN16-2, Augmentation=Pre-defined rotations2023.03 | 77.61 | |
| DKD†Teacher backbone=R32x4, Student backbone=R8x4, Augmentation=Pre-defined rotations2023.03 | 77.52 | |
| CRD†Teacher backbone=WRN40-2, Student backbone=WRN16-2, Augmentation=Pre-defined rotations2023.03 | 77.27 | |
| LogSum distillationTeacher backbone=R50, Student backbone=VGG8, Augmentation=Pre-defined rotations2023.03 | 77.08 | |
| DKD†Teacher backbone=R50, Student backbone=VGG8, Augmentation=Pre-defined rotations2023.03 | 76.88 | |
| CRD†Teacher backbone=WRN40-2, Student backbone=WRN40-1, Augmentation=Pre-defined rotations2023.03 | 76.15 | |
| LogSum distillationTeacher backbone=WRN40-2, Student backbone=WRN40-1, Augmentation=Pre-defined rotations2023.03 | 76.04 | |
| KD†Teacher backbone=WRN40-2, Student backbone=WRN16-2, Augmentation=Pre-defined rotations2023.03 | 75.94 | |
| DKD†Teacher backbone=WRN40-2, Student backbone=WRN40-1, Augmentation=Pre-defined rotations2023.03 | 75.89 | |
| KD†Teacher backbone=R32x4, Student backbone=R8x4, Augmentation=Pre-defined rotations2023.03 | 75.84 | |
| KD†Teacher backbone=R50, Student backbone=VGG8, Augmentation=Pre-defined rotations2023.03 | 75.75 | |
| CRD†Teacher backbone=R50, Student backbone=VGG8, Augmentation=Pre-defined rotations2023.03 | 75.73 | |
| KD†Teacher backbone=WRN40-2, Student backbone=WRN40-1, Augmentation=Pre-defined rotations2023.03 | 75.32 | |
| DKD†Teacher backbone=WRN40-2, Student backbone=WRN16-2, Augmentation=Pre-defined rotations2023.03 | 74.96 | |
| Fractional MPData Augmentation=Extreme, tests=122015.11 | 73.61 | |
| LogSum distillationTeacher backbone=R50, Student backbone=MBv2, Augmentation=Pre-defined rotations2023.03 | 73.51 | |
| DKD†Teacher backbone=R50, Student backbone=MBv2, Augmentation=Pre-defined rotations2023.03 | 73.3 | |
| LogSum distillationTeacher backbone=VGG13, Student backbone=MBv2, Augmentation=Pre-defined rotations2023.03 | 72.82 | |
| Fitnet4-LSUVData Augmentation=Standard, Optimizer=RMSProp2015.11 | 72.34 | |
| Fitnet4-OrthoInitData Augmentation=Standard, Optimizer=RMSProp2015.11 | 72.3 | |
| LogSum distillationTeacher backbone=R56, Student backbone=R20, Augmentation=Pre-defined rotations2023.03 | 72.25 | |
| CRD†Teacher backbone=R56, Student backbone=R20, Augmentation=Pre-defined rotations2023.03 | 72.21 | |
| CRD†Teacher backbone=R50, Student backbone=MBv2, Augmentation=Pre-defined rotations2023.03 | 72.03 | |
| DKD†Teacher backbone=VGG13, Student backbone=MBv2, Augmentation=Pre-defined rotations2023.03 | 72.01 | |
| CRD†Teacher backbone=VGG13, Student backbone=MBv2, Augmentation=Pre-defined rotations2023.03 | 71.65 | |
| KD†Teacher backbone=R50, Student backbone=MBv2, Augmentation=Pre-defined rotations2023.03 | 71.29 | |
| MINData Augmentation=Standard2015.11 | 71.14 | |
| KD†Teacher backbone=R56, Student backbone=R20, Augmentation=Pre-defined rotations2023.03 | 71.1 | |
| DKD†Teacher backbone=R56, Student backbone=R20, Augmentation=Pre-defined rotations2023.03 | 70.95 | |
| KD†Teacher backbone=VGG13, Student backbone=MBv2, Augmentation=Pre-defined rotations2023.03 | 70.79 | |
| Fitnet4-OrthoInitData Augmentation=Standard, Optimizer=SGD2015.11 | 70.44 | |
| Fitnet4-LSUVData Augmentation=Standard, Optimizer=SGD2015.11 | 70.04 | |
| Fractional MPData Augmentation=Extreme, tests=12015.11 | 68.55 | |
| Fitnet4-HighwayData Augmentation=Standard2015.11 | 68.09 | |
| ALL-CNNData Augmentation=Standard2015.11 | 66.29 | |
| maxoutData Augmentation=Standard2015.11 | 65.46 | |
| DSNData Augmentation=Standard2015.11 | 65.43 | |
| Fitnet4-HintsData Augmentation=Standard2015.11 | 64.96 | |
| NiNData Augmentation=Standard2015.11 | 64.32 |