Image Classification on CIFAR100 (test) (Accuracy)
92.04AccuracyTeacher
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TeacherTeacher=ViT-S, Student=ResNet182025.11 | 92.04 | — | |
| TeacherTeacher=ViT-S, Student=MobileNetV22025.11 | 92.04 | — | |
| ViT-B/16Pretraining + MaskSub=true, Finetuning + MaskSub=false2023.06 | 91.9 | — | |
| ViT-B/16Pretraining + MaskSub=false, Finetuning + MaskSub=false2023.06 | 91.7 | — | |
| ViT-S/16Pretraining + MaskSub=true, Finetuning + MaskSub=false2023.06 | 90.6 | — | |
| ViT-S/16Pretraining + MaskSub=false, Finetuning + MaskSub=false2023.06 | 90 | — | |
| ViT-S/16Pretraining + MaskSub=true, Finetuning + MaskSub=true2023.06 | 89.9 | — | |
| ViT-B/16Pretraining + MaskSub=true, Finetuning + MaskSub=true2023.06 | 89.6 | — | |
| TeacherTeacher=Swin-T, Student=ResNet182025.11 | 89.26 | — | |
| TeacherTeacher=Swin-T, Student=MobileNetV22025.11 | 89.26 | — | |
| Linear ProbeInterpretability=false, Evaluation Setting=Fully-supervised, Backbone=CLIP ViT-L/142026.01 | 87.48 | — | |
| TeacherTeacher=Mixer-B/16, Student=ResNet182025.11 | 87.29 | — | |
| TeacherTeacher=Mixer-B/16, Student=MobileNetV22025.11 | 87.29 | — | |
| PCBM-ReDInterpretability=true, Evaluation Setting=Fully-supervised, Backbone=CLIP ViT-L/142026.01 | 87.27 | — | |
| V2C-CBMInterpretability=true, Evaluation Setting=Fully-supervised, Backbone=CLIP ViT-L/142026.01 | 86.41 | — | |
| LaBoInterpretability=true, Evaluation Setting=Fully-supervised, Backbone=CLIP ViT-L/142026.01 | 86.04 | — | |
| RSDTeacher=Swin-T, Student=ResNet182025.11 | 83.92 | — | |
| RSDTeacher=Swin-T, Student=MobileNetV22025.11 | 83.68 | — | |
| Res-CBMInterpretability=true, Evaluation Setting=Fully-supervised, Backbone=CLIP ViT-L/142026.01 | 83.01 | — | |
| ARFCBackbone=SigLip 2 (ViT-B/16), Compression Ratio=75%, Evaluation Protocol=Zero-shot2026.02 | 82.9 | — | |
| HCDTeacher=Swin-T, Student=ResNet182025.11 | 82.78 | 4.04 | |
| HCDTeacher=Swin-T, Student=MobileNetV22025.11 | 82.19 | 7.51 | |
| LDRLDTeacher=Swin-T, Student=ResNet182025.11 | 82.17 | — | |
| RSDTeacher=Mixer-B/16, Student=ResNet182025.11 | 81.85 | — | |
| RSDTeacher=Mixer-B/16, Student=MobileNetV22025.11 | 81.74 | — | |
| RSDTeacher=ViT-S, Student=MobileNetV22025.11 | 81.68 | — | |
| LDRLDTeacher=Swin-T, Student=MobileNetV22025.11 | 81.64 | — | |
| HCDTeacher=Mixer-B/16, Student=ResNet182025.11 | 81.53 | 4.24 | |
| RSDTeacher=ViT-S, Student=ResNet182025.11 | 81.5 | — | |
| TeKAPTeacher=Swin-T, Student=ResNet182025.11 | 81.38 | — | |
| HCDTeacher=ViT-S, Student=ResNet182025.11 | 81.33 | 4.07 | |
| PATTeacher=Swin-T, Student=ResNet182025.11 | 81.22 | — | |
| HCDTeacher=Mixer-B/16, Student=MobileNetV22025.11 | 81.09 | 7.76 | |
| OFATeacher=Swin-T, Student=MobileNetV22025.11 | 80.98 | — | |
| HCDTeacher=ViT-S, Student=MobileNetV22025.11 | 80.81 | 8.04 | |
| LDRLDTeacher=Mixer-B/16, Student=ResNet182025.11 | 80.69 | — | |
| LDRLDTeacher=Mixer-B/16, Student=MobileNetV22025.11 | 80.64 | — | |
| OFATeacher=Swin-T, Student=ResNet182025.11 | 80.54 | — | |
| LDRLDTeacher=ViT-S, Student=ResNet182025.11 | 80.36 | — | |
| DKDTeacher=Swin-T, Student=ResNet182025.11 | 80.26 | — | |
| TeKAPTeacher=Swin-T, Student=MobileNetV22025.11 | 80.23 | — | |
| OFATeacher=ViT-S, Student=ResNet182025.11 | 80.15 | — | |
| PATTeacher=ViT-S, Student=ResNet182025.11 | 80.11 | — | |
| PATTeacher=Mixer-B/16, Student=ResNet182025.11 | 80.07 | — | |
| TeKAPTeacher=Mixer-B/16, Student=ResNet182025.11 | 80.05 | — | |
| TeKAPTeacher=Mixer-B/16, Student=MobileNetV22025.11 | 79.89 | — | |
| CRDTeacher=Swin-T, Student=MobileNetV22025.11 | 79.8 | — | |
| ARFCBackbone=CN-CLIP (ViT-H/14), Compression Ratio=50%, Evaluation Protocol=Zero-shot2026.02 | 79.7 | — | |
| OFATeacher=Mixer-B/16, Student=ResNet182025.11 | 79.39 | — | |
| LDRLDTeacher=ViT-S, Student=MobileNetV22025.11 | 79.21 | — | |
| TeKAPTeacher=ViT-S, Student=ResNet182025.11 | 79.06 | — | |
| FitNetTeacher=Swin-T, Student=ResNet182025.11 | 78.87 | — | |
| PATTeacher=ViT-S, Student=MobileNetV22025.11 | 78.87 | — | |
| PATTeacher=Swin-T, Student=MobileNetV22025.11 | 78.78 | — | |
| OFATeacher=Mixer-B/16, Student=MobileNetV22025.11 | 78.78 | — | |
| KDTeacher=Swin-T, Student=ResNet182025.11 | 78.74 | — | |
| DKDTeacher=Mixer-B/16, Student=ResNet182025.11 | 78.67 | — | |
| PATTeacher=Mixer-B/16, Student=MobileNetV22025.11 | 78.62 | — | |
| CuPLInterpretability=false, Evaluation Setting=Zero-shot, Backbone=CLIP ViT-L/142026.01 | 78.59 | — | |
| PCBM-ReD + CuPLInterpretability=true, Evaluation Setting=Zero-shot, Backbone=CLIP ViT-L/142026.01 | 78.59 | — | |
| OFATeacher=ViT-S, Student=MobileNetV22025.11 | 78.45 | — | |
| TeKAPTeacher=ViT-S, Student=MobileNetV22025.11 | 78.41 | — | |
| CLIPInterpretability=false, Evaluation Setting=Zero-shot, Backbone=CLIP ViT-L/142026.01 | 78.28 | — | |
| PCBM-ReDInterpretability=true, Evaluation Setting=Zero-shot, Backbone=CLIP ViT-L/142026.01 | 78.24 | — | |
| CRDTeacher=Mixer-B/16, Student=MobileNetV22025.11 | 78.15 | — | |
| CRDTeacher=ViT-S, Student=MobileNetV22025.11 | 78.14 | — | |
| DKDTeacher=ViT-S, Student=ResNet182025.11 | 78.1 | — | |
| Parallel TRGLArchitecture=ResNet-101, Number of modules=22023.09 | 77.87 | — | |
| KDTeacher=Mixer-B/16, Student=ResNet182025.11 | 77.79 | — | |
| DISTTeacher=Swin-T, Student=ResNet182025.11 | 77.75 | — | |
| FitNetTeacher=ViT-S, Student=ResNet182025.11 | 77.71 | — | |
| CRDTeacher=Swin-T, Student=ResNet182025.11 | 77.63 | — | |
| Parallel VanGLArchitecture=ResNet-101, Number of modules=22023.09 | 77.31 | — | |
| FPBackbone=EfficientFormer-L32025.03 | 77.26 | — | |
| KDTeacher=ViT-S, Student=ResNet182025.11 | 77.26 | — | |
| FitNetTeacher=Mixer-B/16, Student=ResNet182025.11 | 77.15 | — | |
| HOTBackbone=ResNet-342025.03 | 76.95 | — | |
| FRArchitecture=ResNet-101, Number of modules=22023.09 | 76.9 | — | |
| FPBackbone=ResNet-342025.03 | 76.75 | — | |
| FPBackbone=EfficientFormer-L12025.03 | 76.65 | — | |
| CRDTeacher=ViT-S, Student=ResNet182025.11 | 76.6 | — | |
| Parallel TRGLArchitecture=ResNet-152, Number of modules=22023.09 | 76.55 | — | |
| E2EArchitecture=ResNet-101, Number of modules=22023.09 | 76.52 | — | |
| DISTTeacher=ViT-S, Student=ResNet182025.11 | 76.49 | — | |
| FPBackbone=ResNet-502025.03 | 76.46 | — | |
| CRDTeacher=Mixer-B/16, Student=ResNet182025.11 | 76.42 | — | |
| FRArchitecture=ResNet-152, Number of modules=22023.09 | 76.39 | — | |
| DISTTeacher=Mixer-B/16, Student=ResNet182025.11 | 76.36 | — | |
| LUQBackbone=ResNet-342025.03 | 76.26 | — | |
| LUQBackbone=EfficientFormer-L32025.03 | 76.19 | — | |
| HOTBackbone=EfficientFormer-L32025.03 | 76.19 | — | |
| HOTBackbone=ResNet-502025.03 | 76.06 | — | |
| HOTBackbone=EfficientFormer-L12025.03 | 76.06 | — | |
| LUQBackbone=EfficientFormer-L12025.03 | 75.79 | — | |
| DDGArchitecture=ResNet-101, Number of modules=22023.09 | 75.75 | — | |
| FPBackbone=ResNet-182025.03 | 75.66 | — | |
| LUQBackbone=ResNet-182025.03 | 75.63 | — | |
| HOTBackbone=ResNet-182025.03 | 75.53 | — | |
| Parallel VanGLArchitecture=ResNet-152, Number of modules=22023.09 | 75.4 | — | |
| LBP-WHTBackbone=ResNet-342025.03 | 75.36 | — |