Image Classification on CIFAR100 (test) (Accuracy and Statistical Significance)
79.9AccuracyNAT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| NATConfiguration=D=[2,6,4], H=[3,6,12], Window=7x72025.11 | 79.9 | — | — | |
| HNTConfiguration=D=[2,6,4], H=[3,6,12], Window=492025.11 | 79.9 | — | — | |
| SWINConfiguration=D=[2,6,4], H=[3,6,12], Window=4x42025.11 | 76.6 | — | — | |
| HWTConfiguration=D=[2,6,4], H=[3,6,12], Window=162025.11 | 76.4 | — | — | |
| Trad. KDCompression Ratio=5.0×, Student Architecture=ResNet10, Teacher Architecture=ResNet502025.12 | 73.34 | — | — | |
| HPM-KDCompression Ratio=5.0×, Student Architecture=ResNet10, Teacher Architecture=ResNet502025.12 | 73.21 | 0.57 | 0.025 | |
| DirectCompression Ratio=5.0×, Student Architecture=ResNet102025.12 | 72.64 | — | — | |
| Trad. KDCompression Ratio=2.3×, Student Architecture=ResNet18, Teacher Architecture=ResNet502025.12 | 62.46 | — | — | |
| HPM-KDCompression Ratio=2.3×, Student Architecture=ResNet18, Teacher Architecture=ResNet502025.12 | 62.27 | 1 | 0.003 | |
| DirectCompression Ratio=2.3×, Student Architecture=ResNet182025.12 | 61.27 | — | — | |
| Trad. KDCompression Ratio=7.0×, Student Architecture=MobileNetV2, Teacher Architecture=ResNet502025.12 | 59.08 | — | — | |
| HPM-KDCompression Ratio=7.0×, Student Architecture=MobileNetV2, Teacher Architecture=ResNet502025.12 | 56.86 | 2.04 | — | |
| DirectCompression Ratio=7.0×, Student Architecture=MobileNetV22025.12 | 54.82 | — | — |