Image Classification on CIFAR100 (test)
91.9Test AccuracyGLA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GLAbackbone=ViT-B/162023.10 | 91.9 | — | — | |
| GLABackbone=CLIP ViT-B/162023.10 | 91.9 | — | — | |
| WiSE-FTbackbone=ViT-B/162023.10 | 91.3 | — | — | |
| WiSE-FTBackbone=CLIP ViT-B/162023.10 | 91.3 | — | — | |
| End-to-end fine-tuningbackbone=ViT-B/162023.10 | 91 | — | — | |
| E2EBackbone=CLIP ViT-B/16, Protocol=end-to-end fine-tuning2023.10 | 91 | — | — | |
| GLAbackbone=ViT-B/322023.10 | 90.7 | — | — | |
| GLABackbone=CLIP ViT-B/322023.10 | 90.7 | — | — | |
| WiSE-FTbackbone=ViT-B/322023.10 | 90 | — | — | |
| WiSE-FTBackbone=CLIP ViT-B/322023.10 | 90 | — | — | |
| End-to-end fine-tuningbackbone=ViT-B/322023.10 | 89.4 | — | — | |
| E2EBackbone=CLIP ViT-B/32, Protocol=end-to-end fine-tuning2023.10 | 89.4 | — | — | |
| Linear probebackbone=ViT-B/162023.10 | 83.1 | — | — | |
| LPBackbone=CLIP ViT-B/16, Protocol=linear probe2023.10 | 83.1 | — | — | |
| MaxUp + CutoutBackbone=WideResNet-28-10, Data Augmentation Strategy=MaxUp + Cutout, m (sample size)=102020.02 | 82.48 | — | — | |
| CutoutBackbone=WideResNet-28-10, Data Augmentation Strategy=Cutout2020.02 | 81.59 | — | — | |
| Linear probebackbone=ViT-B/322023.10 | 80.5 | — | — | |
| LPBackbone=CLIP ViT-B/32, Protocol=linear probe2023.10 | 80.5 | — | — | |
| RMSGDNetwork=ResNet101, Augmentation=Cutout2022.03 | 80.36 | — | — | |
| RMSGDNetwork=ResNet50, Augmentation=Cutout2022.03 | 80.06 | — | — | |
| SGDPNetwork=ResNet101, Augmentation=Cutout2022.03 | 80.03 | — | — | |
| RMSGDNetwork=ResNet34, Augmentation=Cutout2022.03 | 79.7 | — | — | |
| SGDPNetwork=ResNet34, Augmentation=Cutout2022.03 | 79.67 | — | — | |
| Teacher BaselineTeacher=resnet32x42020.06 | 79.63 | — | — | |
| Teacher BaselineTeacher=resnet32x42020.06 | 79.63 | — | — | |
| SGDPNetwork=ResNet50, Augmentation=Cutout2022.03 | 79.52 | — | — | |
| SAMNetwork=ResNet101, Augmentation=Cutout2022.03 | 79.41 | — | — | |
| SGDNetwork=ResNet101, Augmentation=Cutout2022.03 | 79.35 | — | — | |
| Teacher BaselineTeacher=ResNet502020.06 | 79.1 | — | — | |
| Teacher BaselineTeacher=ResNet502020.06 | 79.1 | — | — | |
| SGDPNetwork=ResNet18, Augmentation=Cutout2022.03 | 78.82 | — | — | |
| SGDNetwork=ResNet34, Augmentation=Cutout2022.03 | 78.63 | — | — | |
| SSKDTeacher=resnet32x4, Student=ShuffleV22020.06 | 78.61 | — | — | |
| SAMNetwork=ResNet34, Augmentation=Cutout2022.03 | 78.57 | — | — | |
| RMSGDNetwork=ResNet18, Augmentation=Cutout2022.03 | 78.53 | — | — | |
| SSKDTeacher=resnet32x4, Student=ShuffleV12020.06 | 78.44 | — | — | |
| SGDNetwork=ResNet50, Augmentation=Cutout2022.03 | 78.36 | — | — | |
| SGDNetwork=ResNet18, Augmentation=Cutout2022.03 | 78.16 | — | — | |
| RMSGDNetwork=ResNeXt, Augmentation=Cutout2022.03 | 78.06 | — | — | |
| PDC-NLNumber of parameters=12.00 x 10^6, variant=42021.04 | 77.9 | — | — | |
| SGDNetwork=SENet18, Augmentation=Cutout2022.03 | 77.8 | — | — | |
| RMSGDNetwork=SENet18, Augmentation=Cutout2022.03 | 77.77 | — | — | |
| SAMNetwork=ResNet50, Augmentation=Cutout2022.03 | 77.73 | — | — | |
| SGDPNetwork=SENet18, Augmentation=Cutout2022.03 | 77.7 | — | — | |
| SAMNetwork=SENet18, Augmentation=Cutout2022.03 | 77.64 | — | — | |
| SAMNetwork=ResNet18, Augmentation=Cutout2022.03 | 77.58 | — | — | |
| SSKDTeacher=wrn40-2, Student=ShuffleV12020.06 | 77.4 | — | — | |
| PDC-NLNumber of parameters=11.87 x 10^6, variant=32021.04 | 77.3 | — | — | |
| SGDPNetwork=ResNeXt, Augmentation=Cutout2022.03 | 77.14 | — | — | |
| DNLNumber of parameters=11.57 x 10^62021.04 | 77.1 | — | — | |
| NLNumber of parameters=11.57 x 10^62021.04 | 76.9 | — | — | |
| ABTeacher=wrn40-2, Student=ShuffleV12020.06 | 76.58 | — | — | |
| Teacher BaselineTeacher=wrn40-22020.06 | 76.46 | — | — | |
| RMSGDNetwork=MobileNetV2, Augmentation=Cutout2022.03 | 76.36 | — | — | |
| SAMNetwork=ResNeXt, Augmentation=Cutout2022.03 | 76.34 | — | — | |
| ABTeacher=resnet32x4, Student=ShuffleV12020.06 | 76.24 | — | — | |
| CRDTeacher=wrn40-2, Student=ShuffleV12020.06 | 75.96 | — | — | |
| SGDNetwork=ResNeXt, Augmentation=Cutout2022.03 | 75.91 | — | — | |
| VIDTeacher=resnet32x4, Student=ShuffleV22020.06 | 75.78 | — | — | |
| SSKDTeacher=ResNet50, Student=vgg82020.06 | 75.76 | — | — | |
| RKDTeacher=resnet32x4, Student=ShuffleV22020.06 | 75.74 | — | — | |
| CRDTeacher=resnet32x4, Student=ShuffleV22020.06 | 75.72 | — | — | |
| ABTeacher=resnet32x4, Student=ShuffleV22020.06 | 75.66 | — | — | |
| MaxUp + CutoutBackbone=PreAct-ResNet-110, Data Augmentation Strategy=MaxUp + Cutout2020.02 | 75.63 | — | — | |
| ATTeacher=wrn40-2, Student=ShuffleV12020.06 | 75.61 | — | — | |
| ResNet18Number of parameters=11.2 x 10^62021.04 | 75.6 | — | — | |
| SPTeacher=wrn40-2, Student=ShuffleV12020.06 | 75.56 | — | — | |
| FitNetTeacher=wrn40-2, Student=ShuffleV12020.06 | 75.55 | — | — | |
| PKTTeacher=wrn40-2, Student=ShuffleV12020.06 | 75.51 | — | — | |
| CRDTeacher=resnet32x4, Student=ShuffleV12020.06 | 75.46 | — | — | |
| RKDTeacher=wrn40-2, Student=ShuffleV12020.06 | 75.45 | — | — | |
| SAMNetwork=MobileNetV2, Augmentation=Cutout2022.03 | 75.43 | — | — | |
| Teacher BaselineTeacher=vgg132020.06 | 75.38 | — | — | |
| VIDTeacher=wrn40-2, Student=ShuffleV12020.06 | 75.36 | — | — | |
| ATTeacher=resnet32x4, Student=ShuffleV22020.06 | 75.3 | — | — | |
| MaxUp + CutoutBackbone=ResNet-110, Data Augmentation Strategy=MaxUp + Cutout, m (sample size)=42020.02 | 75.26 | — | — | |
| PKTTeacher=resnet32x4, Student=ShuffleV22020.06 | 75.18 | — | — | |
| FTTeacher=wrn40-2, Student=ShuffleV12020.06 | 75.18 | — | — | |
| SPTeacher=resnet32x4, Student=ShuffleV22020.06 | 75.15 | — | — | |
| FitNetTeacher=resnet32x4, Student=ShuffleV22020.06 | 75.11 | — | — | |
| FTTeacher=resnet32x4, Student=ShuffleV22020.06 | 74.95 | — | — | |
| KDTeacher=wrn40-2, Student=ShuffleV12020.06 | 74.83 | — | — | |
| FitNetTeacher=resnet32x4, Student=ShuffleV12020.06 | 74.82 | — | — | |
| ATTeacher=resnet32x4, Student=ShuffleV12020.06 | 74.76 | — | — | |
| SAMNetwork=ShuffleNetV2, Augmentation=Cutout2022.03 | 74.7 | — | — | |
| KDTeacher=resnet32x4, Student=ShuffleV22020.06 | 74.45 | — | — | |
| SGDPNetwork=ShuffleNetV2, Augmentation=Cutout2022.03 | 74.44 | — | — | |
| CRDTeacher=ResNet50, Student=vgg82020.06 | 74.42 | — | — | |
| RMSGDNetwork=ShuffleNetV2, Augmentation=Cutout2022.03 | 74.38 | — | — | |
| CutoutBackbone=PreAct-ResNet-110, Data Augmentation Strategy=Cutout2020.02 | 74.37 | — | — | |
| FTTeacher=resnet32x4, Student=ShuffleV12020.06 | 74.31 | — | — | |
| VIDTeacher=resnet32x4, Student=ShuffleV12020.06 | 74.28 | — | — | |
| ABTeacher=ResNet50, Student=vgg82020.06 | 74.2 | — | — | |
| RKDTeacher=resnet32x4, Student=ShuffleV12020.06 | 74.2 | — | — | |
| SGDNetwork=ShuffleNetV2, Augmentation=Cutout2022.03 | 74.13 | — | — | |
| KDTeacher=resnet32x4, Student=ShuffleV12020.06 | 74.07 | — | — | |
| PKTTeacher=resnet32x4, Student=ShuffleV12020.06 | 74.06 | — | — | |
| SGDNetwork=MobileNetV2, Augmentation=Cutout2022.03 | 73.94 | — | — | |
| SPTeacher=ResNet50, Student=vgg82020.06 | 73.86 | — | — | |
| FitNetTeacher=ResNet50, Student=vgg82020.06 | 73.84 | — | — |