Image Classification on TinyImageNet 44 (test)
42.41AccuracySSKD
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SSKDTeacher training method=SFTN, Architecture=resnet32x4/ShuffleV22021.02 | 42.41 | 4.06 | |
| CRDTeacher training method=SFTN, Architecture=resnet32x4/ShuffleV22021.02 | 40.87 | 5.37 | |
| Teacher accuracyTeacher training method=SFTN, Architecture=resnet32x4/ShuffleV22021.02 | 40.16 | — | |
| OHTeacher training method=SFTN, Architecture=resnet32x4/ShuffleV22021.02 | 39.95 | 6.43 | |
| AVGTeacher training method=SFTN, Architecture=resnet32x4/ShuffleV22021.02 | 39.86 | 6.07 | |
| SSKDTeacher training method=Standard, Architecture=resnet32x4/ShuffleV22021.02 | 38.35 | — | |
| SPTeacher training method=SFTN, Architecture=resnet32x4/ShuffleV22021.02 | 38.28 | 7.12 | |
| KDTeacher training method=SFTN, Architecture=resnet32x4/ShuffleV22021.02 | 37.81 | 7.36 | |
| CRDTeacher training method=Standard, Architecture=resnet32x4/ShuffleV22021.02 | 35.5 | — | |
| Student accuracy w/o KDArchitecture=resnet32x4/ShuffleV22021.02 | 33.81 | — | |
| AVGTeacher training method=Standard, Architecture=resnet32x4/ShuffleV22021.02 | 33.8 | — | |
| OHTeacher training method=Standard, Architecture=resnet32x4/ShuffleV22021.02 | 33.52 | — | |
| Teacher accuracyTeacher training method=Standard, Architecture=resnet32x4/ShuffleV22021.02 | 31.25 | — | |
| SPTeacher training method=Standard, Architecture=resnet32x4/ShuffleV22021.02 | 31.16 | — | |
| KDTeacher training method=Standard, Architecture=resnet32x4/ShuffleV22021.02 | 30.45 | — |