Image Classification on ImageNet 200 (val)
0.3768Top-1 ErrorAdaptive Distillation
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Adaptive DistillationAT Path=true, ST Path=true2021.10 | 0.3768 | 0.2946 | |
| Equal Weight KDAT Path=true, ST Path=true2021.10 | 0.3825 | 0.2983 | |
| Hand-tuned KDAT Path=true, ST Path=true2021.10 | 0.39 | 0.3289 | |
| Multiobjective KDAT Path=true, ST Path=true2021.10 | 0.3975 | 0.3322 | |
| Single KD (AT)AT Path=true, ST Path=false2021.10 | 0.398 | 0.3507 | |
| Single KD (ST)AT Path=false, ST Path=true2021.10 | 0.4024 | 0.3538 | |
| Teacher2021.10 | 0.4081 | — | |
| Student2021.10 | 0.4234 | — |