Image Classification on CIFAR-100 (Acc@1 Best/Final Reporting)
92.04Top-1 AccuracyTeacher baseline
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Teacher baselineTeacher=ViT-S, Student=ResNet182026.07 | 92.04 | — | — | — | — | — | — | |
| Teacher baselineTeacher=ViT-S, Student=MobileNetV22026.07 | 92.04 | — | — | — | — | — | — | |
| Teacher baselineTeacher=Swin-T, Student=ResNet182026.07 | 89.26 | — | — | — | — | — | — | |
| Teacher baselineTeacher=Swin-T, Student=MobileNetV22026.07 | 89.26 | — | — | — | — | — | — | |
| Teacher baselineTeacher=ConvNeXt-T, Student=DeiT-T2026.07 | 88.41 | — | — | — | — | — | — | |
| Teacher baselineTeacher=ConvNeXt-T, Student=Swin-P2026.07 | 88.41 | — | — | — | — | — | — | |
| Teacher baselineTeacher=ConvNeXt-T, Student=ResMLP-S122026.07 | 88.41 | — | — | — | — | — | — | |
| Teacher baselineTeacher=Mixer-B/16, Student=ResNet182026.07 | 87.29 | — | — | — | — | — | — | |
| Teacher baselineTeacher=Mixer-B/16, Student=MobileNetV22026.07 | 87.29 | — | — | — | — | — | — | |
| Teacher baselineTeacher=Mixer-B/16, Student=DeiT-T2026.07 | 87.29 | — | — | — | — | — | — | |
| Teacher baselineTeacher=Mixer-B/16, Student=Swin-P2026.07 | 87.29 | — | — | — | — | — | — | |
| Teacher baselineTeacher=Swin-T, Student=ResMLP-S122026.07 | 87.29 | — | — | — | — | — | — | |
| SFKDTeacher=ConvNeXt-T, Student=ResMLP-S122026.07 | 85.08 | — | — | — | — | — | — | |
| SFKDTeacher=Swin-T, Student=ResMLP-S122026.07 | 84.01 | — | — | — | — | — | — | |
| SFKDTeacher=ConvNeXt-T, Student=DeiT-T2026.07 | 83.91 | — | — | — | — | — | — | |
| SFKDTeacher=Swin-T, Student=ResNet182026.07 | 83.26 | — | — | — | — | — | — | |
| SFKDTeacher=ConvNeXt-T, Student=Swin-P2026.07 | 82.16 | — | — | — | — | — | — | |
| SFKDTeacher=ViT-S, Student=ResNet182026.07 | 82.1 | — | — | — | — | — | — | |
| FBTTeacher=ViT-S, Student=MobileNetV22026.07 | 82.1 | — | — | — | — | — | — | |
| SFKDTeacher=Swin-T, Student=MobileNetV22026.07 | 82.03 | — | — | — | — | — | — | |
| SFKDTeacher=Mixer-B/16, Student=ResNet182026.07 | 81.98 | — | — | — | — | — | — | |
| FBTTeacher=ViT-S, Student=ResNet182026.07 | 81.93 | — | — | — | — | — | — | |
| FBTTeacher=Mixer-B/16, Student=ResNet182026.07 | 81.9 | — | — | — | — | — | — | |
| FBTTeacher=Swin-T, Student=ResNet182026.07 | 81.61 | — | — | — | — | — | — | |
| SFKDTeacher=Mixer-B/16, Student=Swin-P2026.07 | 81.6 | — | — | — | — | — | — | |
| FBTTeacher=Swin-T, Student=MobileNetV22026.07 | 81.28 | — | — | — | — | — | — | |
| SFKDTeacher=Mixer-B/16, Student=MobileNetV22026.07 | 81.17 | — | — | — | — | — | — | |
| SFKDTeacher=Mixer-B/16, Student=DeiT-T2026.07 | 81.14 | — | — | — | — | — | — | |
| OFATeacher=Swin-T, Student=MobileNetV22026.07 | 80.98 | — | — | — | — | — | — | |
| FBTTeacher=Mixer-B/16, Student=MobileNetV22026.07 | 80.83 | — | — | — | — | — | — | |
| FBTTeacher=ConvNeXt-T, Student=Swin-P2026.07 | 80.73 | — | — | — | — | — | — | |
| OFATeacher=Swin-T, Student=ResNet182026.07 | 80.54 | — | — | — | — | — | — | |
| DKDTeacher=Swin-T, Student=ResNet182026.07 | 80.26 | — | — | — | — | — | — | |
| OFATeacher=ViT-S, Student=ResNet182026.07 | 80.15 | — | — | — | — | — | — | |
| SFKDTeacher=ViT-S, Student=MobileNetV22026.07 | 79.97 | — | — | — | — | — | — | |
| CRDTeacher=Swin-T, Student=MobileNetV22026.07 | 79.8 | — | — | — | — | — | — | |
| FBTTeacher=ConvNeXt-T, Student=DeiT-T2026.07 | 79.57 | — | — | — | — | — | — | |
| OFATeacher=Mixer-B/16, Student=ResNet182026.07 | 79.39 | — | — | — | — | — | — | |
| FitNetTeacher=Swin-T, Student=ResNet182026.07 | 78.87 | — | — | — | — | — | — | |
| OFATeacher=Mixer-B/16, Student=MobileNetV22026.07 | 78.78 | — | — | — | — | — | — | |
| KDTeacher=Swin-T, Student=ResNet182026.07 | 78.74 | — | — | — | — | — | — | |
| DKDTeacher=Mixer-B/16, Student=ResNet182026.07 | 78.67 | — | — | — | — | — | — | |
| OFATeacher=ViT-S, Student=MobileNetV22026.07 | 78.45 | — | — | — | — | — | — | |
| FBTTeacher=Mixer-B/16, Student=Swin-P2026.07 | 78.44 | — | — | — | — | — | — | |
| OFATeacher=ConvNeXt-T, Student=Swin-P2026.07 | 78.32 | — | — | — | — | — | — | |
| CRDTeacher=Mixer-B/16, Student=MobileNetV22026.07 | 78.15 | — | — | — | — | — | — | |
| CRDTeacher=ViT-S, Student=MobileNetV22026.07 | 78.14 | — | — | — | — | — | — | |
| DKDTeacher=ViT-S, Student=ResNet182026.07 | 78.1 | — | — | — | — | — | — | |
| FBTTeacher=ConvNeXt-T, Student=ResMLP-S122026.07 | 78.03 | — | — | — | — | — | — | |
| KDTeacher=Mixer-B/16, Student=ResNet182026.07 | 77.79 | — | — | — | — | — | — | |
| DISTTeacher=Swin-T, Student=ResNet182026.07 | 77.75 | — | — | — | — | — | — | |
| FitNetTeacher=ViT-S, Student=ResNet182026.07 | 77.71 | — | — | — | — | — | — | |
| CRDTeacher=Swin-T, Student=ResNet182026.07 | 77.63 | — | — | — | — | — | — | |
| KDTeacher=ViT-S, Student=ResNet182026.07 | 77.26 | — | — | — | — | — | — | |
| FBTTeacher=Swin-T, Student=ResMLP-S122026.07 | 77.2 | — | — | — | — | — | — | |
| FitNetTeacher=Mixer-B/16, Student=ResNet182026.07 | 77.15 | — | — | — | — | — | — | |
| DKDTeacher=ConvNeXt-T, Student=Swin-P2026.07 | 76.8 | — | — | — | — | — | — | |
| OFATeacher=Mixer-B/16, Student=Swin-P2026.07 | 76.65 | — | — | — | — | — | — | |
| CRDTeacher=ViT-S, Student=ResNet182026.07 | 76.6 | — | — | — | — | — | — | |
| DISTTeacher=ViT-S, Student=ResNet182026.07 | 76.49 | — | — | — | — | — | — | |
| KDTeacher=ConvNeXt-T, Student=Swin-P2026.07 | 76.44 | — | — | — | — | — | — | |
| CRDTeacher=Mixer-B/16, Student=ResNet182026.07 | 76.42 | — | — | — | — | — | — | |
| DISTTeacher=ConvNeXt-T, Student=Swin-P2026.07 | 76.41 | — | — | — | — | — | — | |
| DKDTeacher=Mixer-B/16, Student=Swin-P2026.07 | 76.39 | — | — | — | — | — | — | |
| DISTTeacher=Mixer-B/16, Student=ResNet182026.07 | 76.36 | — | — | — | — | — | — | |
| KDTeacher=Mixer-B/16, Student=Swin-P2026.07 | 75.93 | — | — | — | — | — | — | |
| DISTTeacher=Mixer-B/16, Student=Swin-P2026.07 | 75.85 | — | — | — | — | — | — | |
| OFATeacher=ConvNeXt-T, Student=DeiT-T2026.07 | 75.76 | — | — | — | — | — | — | |
| OFATeacher=ConvNeXt-T, Student=ResMLP-S122026.07 | 75.21 | — | — | — | — | — | — | |
| FitNetTeacher=Mixer-B/16, Student=Swin-P2026.07 | 75.2 | — | — | — | — | — | — | |
| KDTeacher=Swin-T, Student=MobileNetV22026.07 | 74.68 | — | — | — | — | — | — | |
| DKDTeacher=ConvNeXt-T, Student=DeiT-T2026.07 | 74.6 | — | — | — | — | — | — | |
| FBTTeacher=Mixer-B/16, Student=DeiT-T2026.07 | 74.4 | — | — | — | — | — | — | |
| FitNetTeacher=Swin-T, Student=MobileNetV22026.07 | 74.28 | — | — | — | — | — | — | |
| CCTeacher=ViT-S, Student=ResNet182026.07 | 74.26 | — | — | — | — | — | — | |
| CCTeacher=Mixer-B/16, Student=ResNet182026.07 | 74.26 | — | — | — | — | — | — | |
| CCTeacher=Swin-T, Student=ResNet182026.07 | 74.19 | — | — | — | — | — | — | |
| RKDTeacher=Swin-T, Student=ResNet182026.07 | 74.11 | — | — | — | — | — | — | |
| Student baselineTeacher=Swin-T, Student=ResNet182026.07 | 74.01 | — | — | — | — | — | — | |
| Student baselineTeacher=ViT-S, Student=ResNet182026.07 | 74.01 | — | — | — | — | — | — | |
| Student baselineTeacher=Mixer-B/16, Student=ResNet182026.07 | 74.01 | — | — | — | — | — | — | |
| OFATeacher=Mixer-B/16, Student=DeiT-T2026.07 | 73.9 | — | — | — | — | — | — | |
| FitNetTeacher=Mixer-B/16, Student=MobileNetV22026.07 | 73.78 | — | — | — | — | — | — | |
| RKDTeacher=Mixer-B/16, Student=ResNet182026.07 | 73.75 | — | — | — | — | — | — | |
| RKDTeacher=ViT-S, Student=ResNet182026.07 | 73.72 | — | — | — | — | — | — | |
| Student baselineTeacher=Swin-T, Student=MobileNetV22026.07 | 73.68 | — | — | — | — | — | — | |
| Student baselineTeacher=ViT-S, Student=MobileNetV22026.07 | 73.68 | — | — | — | — | — | — | |
| Student baselineTeacher=Mixer-B/16, Student=MobileNetV22026.07 | 73.68 | — | — | — | — | — | — | |
| OFATeacher=Swin-T, Student=ResMLP-S122026.07 | 73.58 | — | — | — | — | — | — | |
| DISTTeacher=ConvNeXt-T, Student=DeiT-T2026.07 | 73.55 | — | — | — | — | — | — | |
| FitNetTeacher=ViT-S, Student=MobileNetV22026.07 | 73.54 | — | — | — | — | — | — | |
| DKDTeacher=Mixer-B/16, Student=DeiT-T2026.07 | 73.44 | — | — | — | — | — | — | |
| KDTeacher=Mixer-B/16, Student=MobileNetV22026.07 | 73.33 | — | — | — | — | — | — | |
| CCTeacher=Mixer-B/16, Student=Swin-P2026.07 | 73.32 | — | — | — | — | — | — | |
| DISTTeacher=Mixer-B/16, Student=MobileNetV22026.07 | 73.26 | — | — | — | — | — | — | |
| DKDTeacher=ConvNeXt-T, Student=ResMLP-S122026.07 | 73.22 | — | — | — | — | — | — | |
| KDTeacher=ConvNeXt-T, Student=DeiT-T2026.07 | 72.99 | — | — | — | — | — | — | |
| DISTTeacher=Swin-T, Student=MobileNetV22026.07 | 72.89 | — | — | — | — | — | — | |
| DKDTeacher=Swin-T, Student=ResMLP-S122026.07 | 72.82 | — | — | — | — | — | — | |
| KDTeacher=ViT-S, Student=MobileNetV22026.07 | 72.77 | — | — | — | — | — | — |