Image Classification on ImageNet-1K (val) (Top-1 Error Rate)
0.2345Top-1 Classification Error RateTeacher
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Teacher2021.10 | 0.2345 | — | |
| Adaptive DistillationAT Path=true, ST Path=true2021.10 | 0.2839 | 0.2029 | |
| Equal Weight KDAT Path=true, ST Path=true2021.10 | 0.2873 | 0.2052 | |
| Single KD (ST)AT Path=false, ST Path=true2021.10 | 0.2909 | 0.2166 | |
| Single KD (AT)AT Path=true, ST Path=false2021.10 | 0.2942 | 0.218 | |
| Student2021.10 | 0.301 | — |