Image Classification on Cifar100
92.89Average AccuracyAdam-DualOpt_Fine-tune
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Adam-DualOpt_Fine-tuneBackbone=ViT-B2026.04 | 92.89 | — | |
| SGD-DualOpt_Fine-tuneBackbone=ConvNeXt-B2026.04 | 92.86 | — | |
| L2-SPBackbone=ConvNeXt-B2026.04 | 92.84 | — | |
| FullBackbone=ConvNeXt-B2026.04 | 92.72 | — | |
| Fine-Tunedbackbone=DINOv3 ViT-B/162025.12 | 92 | — | |
| VPTBackbone=ViT-B2026.04 | 91.49 | — | |
| LoRABackbone=ConvNeXt-B2026.04 | 89.37 | — | |
| VPTBackbone=ConvNeXt-B2026.04 | 88.71 | — | |
| Linear Probebackbone=DINOv3 ViT-B/162025.12 | 88.5 | — | |
| CoKeMulti-crop training trick=false2021.05 | 88.2 | — | |
| L2-SPBackbone=ViT-B2026.04 | 88.17 | — | |
| BYOLMulti-crop training trick=false2021.05 | 87.9 | — | |
| FullBackbone=ViT-B2026.04 | 87.76 | — | |
| DINOMulti-crop training trick=true2021.05 | 87.6 | — | |
| SwAVMulti-crop training trick=true2021.05 | 87.5 | — | |
| Barlow TwinsMulti-crop training trick=false2021.05 | 87.4 | — | |
| LoRABackbone=ViT-B2026.04 | 87.03 | — | |
| Task Matrixbackbone=DINOv3 ViT-B/16, best layer=112025.12 | 86.7 | — | |
| SupervisedMulti-crop training trick=false2021.05 | 86.6 | — | |
| MoCo-v2Multi-crop training trick=false2021.05 | 86.1 | — | |
| SLAMDLayer=72026.05 | 84.38 | — | |
| SLAMDLayer=82026.05 | 83.78 | — | |
| SWSLayer=82026.05 | 83.61 | — | |
| SLAMDLayer=62026.05 | 82.77 | — | |
| SWSLayer=72026.05 | 82.19 | — | |
| LinearBackbone=ConvNeXt-B2026.04 | 81.7 | — | |
| TLEGLayer=82026.05 | 81.4 | — | |
| SWSLayer=62026.05 | 80.39 | — | |
| TLEGLayer=72026.05 | 80.03 | — | |
| TeacherTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 79.42 | — | |
| TLEGLayer=62026.05 | 77.01 | — | |
| Target-aware Transformer w/o LKLTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 76.06 | — | |
| Target-aware Transformer w/o LKLTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 75.89 | — | |
| ICKDTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 75.64 | — | |
| TeacherTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 75.61 | — | |
| TeacherTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 75.61 | — | |
| CRDTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 75.51 | — | |
| CRDTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 75.48 | — | |
| ICKDTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 75.25 | — | |
| Target-aware Transformer w/o LKLTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 74.97 | — | |
| KDTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 74.92 | — | |
| TeacherTeacher Architecture=VGG13, Student Architecture=VGG82022.05 | 74.64 | — | |
| PKTTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 74.54 | — | |
| Target-aware Transformer w/o LKLTeacher Architecture=VGG13, Student Architecture=VGG82022.05 | 74.39 | — | |
| ICKDTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 74.33 | — | |
| TeacherTeacher Architecture=ResNet110, Student Architecture=ResNet202022.05 | 74.31 | — | |
| TeacherTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 74.31 | — | |
| CRDTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 74.14 | — | |
| ATTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 74.08 | — | |
| Target-aware Transformer w/o LKLTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 74.05 | — | |
| CRDTeacher Architecture=VGG13, Student Architecture=VGG82022.05 | 73.94 | — | |
| ICKDTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 73.89 | — | |
| SPTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 73.83 | — | |
| NSTTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 73.68 | — | |
| PKTTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 73.64 | — | |
| FitNetTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 73.58 | — | |
| CCTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 73.56 | — | |
| KDTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 73.54 | — | |
| FitNetTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 73.5 | — | |
| CRDTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 73.48 | — | |
| PKTTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 73.45 | — | |
| ATTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 73.44 | — | |
| ICKDTeacher Architecture=VGG13, Student Architecture=VGG82022.05 | 73.42 | — | |
| RKDTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 73.35 | — | |
| KDTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 73.33 | — | |
| NSTTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 73.3 | — | |
| VanillaTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 73.26 | — | |
| KDTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 73.08 | — | |
| KDTeacher Architecture=VGG13, Student Architecture=VGG82022.05 | 72.98 | — | |
| CCTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 72.97 | — | |
| SPTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 72.94 | — | |
| FSPTeacher Architecture=WRN-40-2, Student Architecture=WRN-16-22022.05 | 72.91 | — | |
| PKTTeacher Architecture=VGG13, Student Architecture=VGG82022.05 | 72.88 | — | |
| ATTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 72.77 | — | |
| SPTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 72.69 | — | |
| SPTeacher Architecture=VGG13, Student Architecture=VGG82022.05 | 72.68 | — | |
| FSPTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 72.62 | — | |
| PKTTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 72.61 | — | |
| VanillaTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 72.5 | — | |
| LinearBackbone=ViT-B2026.04 | 72.5 | — | |
| SPTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 72.43 | — | |
| TeacherTeacher Architecture=ResNet56, Student Architecture=ResNet202022.05 | 72.34 | — | |
| ATTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 72.31 | — | |
| FitNetTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 72.24 | — | |
| NSTTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 72.24 | — | |
| RKDTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 72.22 | — | |
| CCTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 72.21 | — | |
| VanillaTeacher Architecture=WRN-40-2, Student Architecture=WRN-40-12022.05 | 71.98 | — | |
| NSTTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 71.96 | — | |
| RKDTeacher Architecture=ResNet32x4, Student Architecture=ResNet8x42022.05 | 71.9 | — | |
| FSPTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 71.89 | — | |
| RKDTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 71.82 | — | |
| ICKDTeacher Architecture=ResNet56, Student Architecture=ResNet202022.05 | 71.76 | — | |
| Target-aware Transformer w/o LKLTeacher Architecture=ResNet110, Student Architecture=ResNet202022.05 | 71.7 | — | |
| ICKDTeacher Architecture=ResNet110, Student Architecture=ResNet202022.05 | 71.68 | — | |
| Target-aware Transformer w/o LKLTeacher Architecture=ResNet56, Student Architecture=ResNet202022.05 | 71.59 | — | |
| NSTTeacher Architecture=VGG13, Student Architecture=VGG82022.05 | 71.53 | — | |
| CCTeacher Architecture=ResNet110, Student Architecture=ResNet322022.05 | 71.48 | — | |
| RKDTeacher Architecture=VGG13, Student Architecture=VGG82022.05 | 71.48 | — | |
| CRDTeacher Architecture=ResNet110, Student Architecture=ResNet202022.05 | 71.46 | — |