Image Classification on CIFAR-100 (test) (Standard Accuracy with Delta)
77.23AccuracyCRD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CRDTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 77.23 | 1.32 | |
| CRDTeacher/Student pair=resnet32x4/resnet8x4, Teacher training=SFTN2021.02 | 76.95 | 1.41 | |
| FitNetsTeacher/Student pair=resnet32x4/resnet8x4, Teacher training=SFTN2021.02 | 76.89 | 1.55 | |
| ATTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 76.82 | 0.97 | |
| SSKDTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 76.8 | 0.84 | |
| VIDTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 76.79 | 1.16 | |
| SPTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 76.77 | 1.34 | |
| FitNetsTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 76.73 | 1.01 | |
| PKTTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 76.57 | 0.86 | |
| FTTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 76.51 | 0.91 | |
| RKDTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 76.49 | 1.01 | |
| OHTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 76.39 | 0.39 | |
| KDTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 76.25 | 0.79 | |
| KDTeacher/Student pair=resnet32x4/resnet8x4, Teacher training=SFTN2021.02 | 76.09 | 2.7 | |
| OHTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 76 | — | |
| SSKDTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 75.96 | — | |
| CRDTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 75.91 | — | |
| ATTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 75.85 | — | |
| FitNetsTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 75.72 | — | |
| PKTTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 75.71 | — | |
| VIDTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 75.63 | — | |
| FTTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 75.6 | — | |
| CRDTeacher/Student pair=resnet32x4/resnet8x4, Teacher training=Standard2021.02 | 75.54 | — | |
| RKDTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 75.48 | — | |
| KDTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 75.46 | — | |
| SPTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 75.43 | — | |
| FitNetsTeacher/Student pair=resnet32x4/resnet8x4, Teacher training=Standard2021.02 | 75.34 | — | |
| KDTeacher/Student pair=resnet32x4/resnet8x4, Teacher training=Standard2021.02 | 73.39 | — | |
| ABTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=SFTN2021.02 | 70.76 | 0.64 | |
| ABTeacher/Student pair=WRN40-2/WRN16-2, Teacher training=Standard2021.02 | 70.12 | — | |
| KDTeacher/Student pair=resnet32x4/resnet8x2, Teacher training=SFTN2021.02 | 69.17 | 1.74 | |
| KDTeacher/Student pair=resnet32x4/resnet8x2, Teacher training=Standard2021.02 | 67.43 | — |