Fine-grained Image Classification on CUB
91.81Top-1 AccSLAD
Evaluation Results
| Method | Links | |
|---|---|---|
| SLADStudent=ViT-B, Teacher=ViT-L2026.05 | 91.81 | |
| LoRAStudent=ViT-B, Teacher=ViT-L2026.05 | 91.41 | |
| Probing*Student=ViT-B, Teacher=ViT-L2026.05 | 90.61 | |
| SLADStudent=ViT-S, Teacher=ViT-B2026.05 | 90.54 | |
| SLADStudent=ViT-S, Teacher=ViT-L2026.05 | 90.44 | |
| LoRAStudent=ViT-S, Teacher=ViT-L2026.05 | 90.04 | |
| LoRAStudent=ViT-S, Teacher=ViT-B2026.05 | 90.01 | |
| Probing*Student=ViT-S, Teacher=ViT-B2026.05 | 89.8 | |
| ProbingStudent=ViT-S, Teacher=ViT-L2026.05 | 89.7 | |
| Probing*Student=ViT-S, Teacher=ViT-L2026.05 | 89.61 | |
| MPO2025.10 | 78.6 | |
| w/ LaViDStudent=MNV2, Teacher=QN+R502026.06 | 75.62 | |
| LSStudent=MNV2, Teacher=RN-502026.06 | 73.03 | |
| LaViDStudent=MNV2, Teacher=Qwen2026.06 | 72.52 | |
| w/ LaViDStudent=RN-18, Teacher=QN+R502026.06 | 72.46 | |
| MaKDStudent=MNV2, Teacher=InternVL2026.06 | 72.1 | |
| CRDStudent=MNV2, Teacher=LLaVA2026.06 | 71.96 | |
| w/ LaViDStudent=SNV2, Teacher=QN+R502026.06 | 71.78 | |
| PE22025.10 | 71.6 | |
| SEE2025.10 | 71.6 | |
| MLKDStudent=MNV2, Teacher=RN-502026.06 | 71.3 | |
| LSStudent=RN-18, Teacher=RN-502026.06 | 70.42 | |
| LSStudent=SNV2, Teacher=RN-502026.06 | 70.27 | |
| LaViDStudent=RN-18, Teacher=Qwen2026.06 | 70.15 | |
| ProTeGi2025.10 | 70 | |
| FitNetStudent=MNV2, Teacher=LLaVA2026.06 | 70 | |
| DKDStudent=MNV2, Teacher=RN-502026.06 | 69.92 | |
| KDStudent=MNV2, Teacher=RN-502026.06 | 69.89 | |
| Ind StudentStudent=MNV2, Teacher=None2026.06 | 69.69 | |
| CRDStudent=RN-18, Teacher=LLaVA2026.06 | 69.47 | |
| MLKDStudent=SNV2, Teacher=RN-502026.06 | 69.3 | |
| DSeq-JEPAArch.=ViT-H/16448, Epochs=300, View Data Augmentation=false2025.11 | 68.9 | |
| MLKDStudent=RN-18, Teacher=RN-502026.06 | 68.76 | |
| LaViDStudent=SNV2, Teacher=Qwen2026.06 | 68.53 | |
| MaKDStudent=SNV2, Teacher=InternVL2026.06 | 68.33 | |
| DSeq-C-JEPAArch.=ViT-L/16, Epochs=600, View Data Augmentation=false2025.11 | 68.3 | |
| MaKDStudent=RN-18, Teacher=InternVL2026.06 | 68.19 | |
| CRDStudent=SNV2, Teacher=LLaVA2026.06 | 68.17 | |
| DKDStudent=SNV2, Teacher=RN-502026.06 | 68.11 | |
| DSeq-JEPAArch.=ViT-L/16, Epochs=600, View Data Augmentation=false2025.11 | 68.1 | |
| RKDStudent=MNV2, Teacher=RN-502026.06 | 67.87 | |
| iBOTArch.=ViT-B/16, Epochs=1600, View Data Augmentation=true2025.11 | 67.7 | |
| DKDStudent=RN-18, Teacher=RN-502026.06 | 67.67 | |
| APE2025.10 | 67.3 | |
| I-JEPAArch.=ViT-L/16, Epochs=600, View Data Augmentation=false2025.11 | 66.9 | |
| BYOL+CVSABackbone=ResNet-50, Pre-training Setting=Second-stage only (800 epochs), Evaluation Protocol=Fine-tuned2021.06 | 66.88 | |
| Rot-PredBackbone=ResNet-50, Pre-training Setting=Second-stage only (800 epochs), Evaluation Protocol=Fine-tuned2021.06 | 66.67 | |
| DSeq-C-JEPAArch.=ViT-B/16, Epochs=600, View Data Augmentation=false2025.11 | 66.5 | |
| LooC*Backbone=ResNet-50, Pre-training Setting=Second-stage only (800 epochs), Evaluation Protocol=Fine-tuned2021.06 | 66.42 | |
| DSeq-JEPAArch.=ViT-B/16, Epochs=600, View Data Augmentation=false2025.11 | 66.2 | |
| BYOL+DiLoBackbone=ResNet-50, Pre-training Setting=Second-stage only (800 epochs), Evaluation Protocol=Fine-tuned2021.06 | 66.16 | |
| Rel-LocBackbone=ResNet-50, Pre-training Setting=Second-stage only (800 epochs), Evaluation Protocol=Fine-tuned2021.06 | 65.89 | |
| C-JEPAArch.=ViT-L/16, Epochs=600, View Data Augmentation=false2025.11 | 65.8 | |
| KDStudent=SNV2, Teacher=RN-502026.06 | 65.59 | |
| I-JEPAArch.=ViT-B/16, Epochs=600, View Data Augmentation=false2025.11 | 65.3 | |
| Ind StudentStudent=SNV2, Teacher=None2026.06 | 65.26 | |
| C-JEPAArch.=ViT-B/16, Epochs=600, View Data Augmentation=false2025.11 | 64.9 | |
| InsLocBackbone=ResNet-50, Pre-training Setting=Second-stage only (800 epochs), Evaluation Protocol=Fine-tuned2021.06 | 64.87 | |
| BYOLBackbone=ResNet-50, Pre-training Setting=Second-stage only (800 epochs), Evaluation Protocol=Fine-tuned2021.06 | 64.85 | |
| FitNetStudent=SNV2, Teacher=LLaVA2026.06 | 64.82 | |
| KDStudent=RN-18, Teacher=RN-502026.06 | 64.76 | |
| SimCLRBackbone=ResNet-50, Pre-training Setting=Second-stage only (800 epochs), Evaluation Protocol=Fine-tuned2021.06 | 63.43 | |
| MAEArch.=ViT-L/16, Epochs=1600, View Data Augmentation=false2025.11 | 63.4 | |
| MoCo.v2Backbone=ResNet-50, Pre-training Setting=Second-stage only (800 epochs), Evaluation Protocol=Fine-tuned2021.06 | 63.21 | |
| Ind StudentStudent=RN-18, Teacher=None2026.06 | 63.07 | |
| FitNetStudent=RN-18, Teacher=LLaVA2026.06 | 62.95 | |
| RKDStudent=RN-18, Teacher=RN-502026.06 | 61.7 | |
| RKDStudent=SNV2, Teacher=RN-502026.06 | 60.99 | |
| MAEArch.=ViT-B/16, Epochs=1600, View Data Augmentation=false2025.11 | 59.8 | |
| OPRO2025.10 | 59.7 | |
| EvoPrompt2025.10 | 59.6 | |
| 3-Shotshots=32025.10 | 58.8 | |
| RandomBackbone=ResNet-50, Pre-training Setting=Random initialization, Evaluation Protocol=Fine-tuned2021.06 | 58.51 | |
| 5-Shotshots=52025.10 | 58.1 | |
| 1-Shotshots=12025.10 | 54.7 | |
| CoTprompting=Chain-of-Thought2025.10 | 49 | |
| Human2025.10 | 47.9 | |
| DINOArch.=ViT-B/16, Epochs=1600, View Data Augmentation=true2025.11 | 33.6 |