Image Classification on CIFAR-100 (test) (Top-1, Top-5, ECE, AURC)
83.3Top-1 AccPS-KD + IPWD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PS-KD + IPWDBackbone=ResNeXt-29, Setting=one-stage self distillation2022.10 | 83.3 | 96.6 | 4.93 | 37.49 | |
| PS-KDBackbone=ResNeXt-29, Setting=one-stage self distillation2022.10 | 82.72 | 96.4 | 9.15 | 39.78 | |
| TF-KDBackbone=ResNeXt-29, Setting=one-stage self distillation2022.10 | 82.67 | 96.13 | 6.73 | 40.34 | |
| LSBackbone=ResNeXt-29, Setting=one-stage self distillation2022.10 | 82.4 | 95.77 | 22.14 | 41.92 | |
| CS-KDBackbone=ResNeXt-29, Setting=one-stage self distillation2022.10 | 81.74 | 95.63 | 5.95 | 42.11 | |
| PS-KD + IPWDBackbone=DenseNet-121, Setting=one-stage self distillation2022.10 | 81.6 | 96.04 | 3.48 | 45.33 | |
| PS-KD + IPWDBackbone=ResNet-101, Setting=one-stage self distillation2022.10 | 81.39 | 95.91 | 3.19 | 43.82 | |
| ResNeXt-29 (Baseline)Backbone=ResNeXt-29, Setting=one-stage self distillation2022.10 | 81.35 | 95.53 | 4.17 | 44.27 | |
| PS-KDBackbone=DenseNet-121, Setting=one-stage self distillation2022.10 | 81.27 | 96.1 | 3.71 | 45.55 | |
| PS-KDBackbone=ResNet-101, Setting=one-stage self distillation2022.10 | 80.57 | 95.7 | 6.92 | 49.01 | |
| LSBackbone=DenseNet-121, Setting=one-stage self distillation2022.10 | 80.2 | 94.54 | 0.92 | 91.06 | |
| LSBackbone=ResNet-101, Setting=one-stage self distillation2022.10 | 80.16 | 94.93 | 3.43 | 95.76 | |
| TF-KDBackbone=DenseNet-121, Setting=one-stage self distillation2022.10 | 80.12 | 94.9 | 7.33 | 69.23 | |
| DenseNet-121 (Baseline)Backbone=DenseNet-121, Setting=one-stage self distillation2022.10 | 79.95 | 95.01 | 7.34 | 52.21 | |
| TF-KDBackbone=ResNet-101, Setting=one-stage self distillation2022.10 | 79.9 | 94.9 | 6.14 | 58.8 | |
| PS-KD + IPWDBackbone=ResNet-18, Setting=one-stage self distillation2022.10 | 79.82 | 95.15 | 1.39 | 49.71 | |
| CS-KDBackbone=DenseNet-121, Setting=one-stage self distillation2022.10 | 79.53 | 93.79 | 13.8 | 73.37 | |
| ResNet-101 (Baseline)Backbone=ResNet-101, Setting=one-stage self distillation2022.10 | 79.25 | 94.72 | 10.02 | 55.45 | |
| CS-KDBackbone=ResNet-101, Setting=one-stage self distillation2022.10 | 79.24 | 94.38 | 12.18 | 64.44 | |
| PS-KDBackbone=ResNet-18, Setting=one-stage self distillation2022.10 | 79.18 | 94.9 | 1.77 | 52.1 | |
| LSBackbone=ResNet-18, Setting=one-stage self distillation2022.10 | 79.06 | 93.98 | 10.79 | 57.74 | |
| CS-KDBackbone=ResNet-18, Setting=one-stage self distillation2022.10 | 78.7 | 94.3 | 6.24 | 56.56 | |
| TF-KDBackbone=ResNet-18, Setting=one-stage self distillation2022.10 | 77.12 | 93.99 | 11.96 | 61.77 | |
| ResNet-18 (Baseline)Backbone=ResNet-18, Setting=one-stage self distillation2022.10 | 75.82 | 93.1 | 11.84 | 67.65 |