Image Classification on CIFAR-10 (val) (with Agreement Error Metric)
0.0439Top-1 ErrorAdaptive Distillation
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Adaptive DistillationAT Path=true, ST Path=true2021.10 | 0.0439 | 0.0312 | |
| Single KD (AT)AT Path=true, ST Path=false2021.10 | 0.0451 | 0.032 | |
| Teacher2021.10 | 0.0463 | — | |
| Multiobjective KDAT Path=true, ST Path=true2021.10 | 0.0465 | 0.0363 | |
| Hand-tuned KDAT Path=true, ST Path=true2021.10 | 0.0475 | 0.0374 | |
| Equal Weight KDAT Path=true, ST Path=true2021.10 | 0.0505 | 0.0423 | |
| Single KD (ST)AT Path=false, ST Path=true2021.10 | 0.051 | 0.0406 | |
| Student2021.10 | 0.0519 | — |