Image Classification on CUB200 (val)
91.99AccuracyViT-B + DenoiseRep
Evaluation Results
| Method | Links | |
|---|---|---|
| ViT-B + DenoiseRepParam=87M, Configuration=+DenoiseRep2024.06 | 91.99 | |
| ViT-BParam=87M, Configuration=Baseline2024.06 | 91.78 | |
| LogicCBM2025.12 | 81.13 | |
| OTTEREvaluation Protocol=Linear Probing, Label Distribution Estimation=BBSE+OT2024.04 | 75.6 | |
| VANILLA CBM2025.12 | 75.2 | |
| LFCBM2025.12 | 74.29 | |
| MLP CBM2025.12 | 72.63 | |
| Linear Probing baselineEvaluation Protocol=Linear Probing, Label Distribution Estimation=None2024.04 | 72.2 | |
| SPARSE CBM2025.12 | 70.28 | |
| SD-DKDTeacher=VGG13, Student=VGG8, Teacher Acc=70.19, Student Acc=46.322024.03 | 68.67 | |
| SD-NKDTeacher=VGG13, Student=VGG8, Teacher Acc=70.19, Student Acc=46.322024.03 | 68.37 | |
| SemCKDTeacher=VGG13, Student=MobileNetV2, Teacher Acc=70.19, Student Acc=40.232024.03 | 68.23 | |
| SD-KDTeacher=VGG13, Student=VGG8, Teacher Acc=70.19, Student Acc=46.322024.03 | 67.32 | |
| DKDTeacher=VGG13, Student=VGG8, Teacher Acc=70.19, Student Acc=46.322024.03 | 67.2 | |
| NKDTeacher=VGG13, Student=VGG8, Teacher Acc=70.19, Student Acc=46.322024.03 | 67.16 | |
| ReviewKDTeacher=VGG13, Student=VGG8, Teacher Acc=70.19, Student Acc=46.322024.03 | 67.1 | |
| MGDTeacher=VGG13, Student=VGG8, Teacher Acc=70.19, Student Acc=46.322024.03 | 66.89 | |
| SemCKDTeacher=VGG13, Student=VGG8, Teacher Acc=70.19, Student Acc=46.322024.03 | 66.54 | |
| CRDTeacher=VGG13, Student=VGG8, Teacher Acc=70.19, Student Acc=46.322024.03 | 66.1 | |
| SD-DKDTeacher=ResNet32x4, Student=ShuffleNetV1, Teacher Acc=66.17, Student Acc=37.282024.03 | 65.58 | |
| SD-NKDTeacher=ResNet32x4, Student=ShuffleNetV1, Teacher Acc=66.17, Student Acc=37.282024.03 | 65.5 | |
| SD-KDTeacher=ResNet32x4, Student=ShuffleNetV1, Teacher Acc=66.17, Student Acc=37.282024.03 | 65.46 | |
| SD-DKDTeacher=VGG13, Student=MobileNetV2, Teacher Acc=70.19, Student Acc=40.232024.03 | 64.86 | |
| POSTHOC CBM2025.12 | 64.65 | |
| SD-NKDTeacher=VGG13, Student=MobileNetV2, Teacher Acc=70.19, Student Acc=40.232024.03 | 64.63 | |
| DKDTeacher=ResNet32x4, Student=ShuffleNetV1, Teacher Acc=66.17, Student Acc=37.282024.03 | 64.51 | |
| KDTeacher=VGG13, Student=VGG8, Teacher Acc=70.19, Student Acc=46.322024.03 | 64.18 | |
| ReviewKDTeacher=ResNet32x4, Student=ShuffleNetV1, Teacher Acc=66.17, Student Acc=37.282024.03 | 64.12 | |
| NKDTeacher=ResNet32x4, Student=ShuffleNetV1, Teacher Acc=66.17, Student Acc=37.282024.03 | 64 | |
| SemCKDTeacher=ResNet32x4, Student=ShuffleNetV1, Teacher Acc=66.17, Student Acc=37.282024.03 | 63.78 | |
| BOOLEAN CBM2025.12 | 63.57 | |
| BBSE+PMEvaluation Protocol=Linear Probing, Label Distribution Estimation=BBSE+PM2024.04 | 63.3 | |
| SD-DKDTeacher=ResNet32x4, Student=MobileNetV2, Teacher Acc=66.17, Student Acc=40.232024.03 | 62.97 | |
| SD-NKDTeacher=ResNet32x4, Student=MobileNetV2, Teacher Acc=66.17, Student Acc=40.232024.03 | 62.69 | |
| CRDTeacher=ResNet32x4, Student=ShuffleNetV1, Teacher Acc=66.17, Student Acc=37.282024.03 | 62.28 | |
| SPTeacher=ResNet32x4, Student=ShuffleNetV1, Teacher Acc=66.17, Student Acc=37.282024.03 | 61.83 | |
| KDTeacher=ResNet32x4, Student=ShuffleNetV1, Teacher Acc=66.17, Student Acc=37.282024.03 | 61.68 | |
| SD-DKDTeacher=ResNet50, Student=ShuffleNetV1, Teacher Acc=60.01, Student Acc=37.282024.03 | 60.66 | |
| SD-KDTeacher=ResNet50, Student=ShuffleNetV1, Teacher Acc=60.01, Student Acc=37.282024.03 | 60.56 | |
| SD-KDTeacher=ResNet32x4, Student=MobileNetV2, Teacher Acc=66.17, Student Acc=40.232024.03 | 60.51 | |
| SD-NKDTeacher=ResNet50, Student=ShuffleNetV1, Teacher Acc=60.01, Student Acc=37.282024.03 | 60.42 | |
| VLG-CBM2025.12 | 60.38 | |
| DKDTeacher=ResNet32x4, Student=MobileNetV2, Teacher Acc=66.17, Student Acc=40.232024.03 | 59.94 | |
| NKDTeacher=ResNet32x4, Student=MobileNetV2, Teacher Acc=66.17, Student Acc=40.232024.03 | 59.81 | |
| SD-KDTeacher=VGG13, Student=MobileNetV2, Teacher Acc=70.19, Student Acc=40.232024.03 | 59.8 | |
| DKDTeacher=ResNet50, Student=ShuffleNetV1, Teacher Acc=60.01, Student Acc=37.282024.03 | 59.21 | |
| NKDTeacher=ResNet50, Student=ShuffleNetV1, Teacher Acc=60.01, Student Acc=37.282024.03 | 59.11 | |
| ReviewKDTeacher=VGG13, Student=MobileNetV2, Teacher Acc=70.19, Student Acc=40.232024.03 | 58.66 | |
| DKDTeacher=VGG13, Student=MobileNetV2, Teacher Acc=70.19, Student Acc=40.232024.03 | 58.45 | |
| NKDTeacher=VGG13, Student=MobileNetV2, Teacher Acc=70.19, Student Acc=40.232024.03 | 58.4 | |
| CRDTeacher=ResNet32x4, Student=MobileNetV2, Teacher Acc=66.17, Student Acc=40.232024.03 | 57.45 | |
| CRDTeacher=ResNet50, Student=ShuffleNetV1, Teacher Acc=60.01, Student Acc=37.282024.03 | 57.45 | |
| KDTeacher=ResNet50, Student=ShuffleNetV1, Teacher Acc=60.01, Student Acc=37.282024.03 | 57.21 | |
| SemCKDTeacher=ResNet50, Student=ShuffleNetV1, Teacher Acc=60.01, Student Acc=37.282024.03 | 57.2 | |
| MGDTeacher=ResNet50, Student=ShuffleNetV1, Teacher Acc=60.01, Student Acc=37.282024.03 | 57.12 | |
| SemCKDTeacher=ResNet32x4, Student=MobileNetV2, Teacher Acc=66.17, Student Acc=40.232024.03 | 56.89 | |
| CRDTeacher=VGG13, Student=MobileNetV2, Teacher Acc=70.19, Student Acc=40.232024.03 | 56.45 | |
| KDTeacher=ResNet32x4, Student=MobileNetV2, Teacher Acc=66.17, Student Acc=40.232024.03 | 56.09 | |
| SPTeacher=ResNet50, Student=ShuffleNetV1, Teacher Acc=60.01, Student Acc=37.282024.03 | 55.31 | |
| SPTeacher=VGG13, Student=VGG8, Teacher Acc=70.19, Student Acc=46.322024.03 | 54.78 | |
| KDTeacher=VGG13, Student=MobileNetV2, Teacher Acc=70.19, Student Acc=40.232024.03 | 53.98 | |
| SPTeacher=ResNet32x4, Student=MobileNetV2, Teacher Acc=66.17, Student Acc=40.232024.03 | 48.49 | |
| Zero-Shot baselineEvaluation Protocol=Zero-Shot, Label Distribution Estimation=None2024.04 | 46 | |
| OTTEREvaluation Protocol=Zero-Shot, Label Distribution Estimation=BBSE+OT2024.04 | 45.5 | |
| SPTeacher=VGG13, Student=MobileNetV2, Teacher Acc=70.19, Student Acc=40.232024.03 | 44.28 | |
| BBSE+PMEvaluation Protocol=Zero-Shot, Label Distribution Estimation=BBSE+PM2024.04 | 3.3 |