Image Classification on ImageNet (val) (Top-1 Error, Top-5 Error)
26.7Top-1 ErrorTeacher
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TeacherBackbone=ResNet-342020.11 | 26.7 | 8.58 | |
| Ours (l2 + LSH)Teacher Backbone=ResNet-34, Student Backbone=ResNet-18, loss=l2 + LSH2020.11 | 28.28 | 9.59 | |
| SSKDTeacher Backbone=ResNet-34, Student Backbone=ResNet-182020.11 | 28.38 | 9.33 | |
| Ours (l2)Teacher Backbone=ResNet-34, Student Backbone=ResNet-18, loss=l22020.11 | 28.61 | 9.61 | |
| CRD+KDTeacher Backbone=ResNet-34, Student Backbone=ResNet-182020.11 | 28.62 | 9.51 | |
| CRDTeacher Backbone=ResNet-34, Student Backbone=ResNet-182020.11 | 28.83 | 9.87 | |
| ATTeacher Backbone=ResNet-34, Student Backbone=ResNet-182020.11 | 29.3 | 10 | |
| KDTeacher Backbone=ResNet-34, Student Backbone=ResNet-182020.11 | 29.34 | 10.12 | |
| SPTeacher Backbone=ResNet-34, Student Backbone=ResNet-182020.11 | 29.38 | 10.2 | |
| Online-KDTeacher Backbone=ResNet-34, Student Backbone=ResNet-182020.11 | 29.45 | 10.41 | |
| CCTeacher Backbone=ResNet-34, Student Backbone=ResNet-182020.11 | 30.04 | 10.83 | |
| StudentBackbone=ResNet-182020.11 | 30.25 | 10.93 |