Image Classification on CUB-200 (test)
95.8AccuracyBlack-box
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Black-boxModel backbone=CLIP-large (395M)2026.03 | 95.8 | — | — | — | — | — | — | — | — | |
| Black-boxModel backbone=CLIP-base (110M)2026.03 | 91.3 | — | — | — | — | — | — | — | — | |
| C x SUsing training-set Examples at test time (Ex)=true, Comparing images at the Image level (Img)=true, Comparing images at the Patch level (Patch)=false, Re-ranking initial predictions (R)=true, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 88.59 | — | — | — | — | — | — | — | — | |
| ProtoKNNUsing training-set Examples at test time (Ex)=true, Comparing images at the Image level (Img)=false, Comparing images at the Patch level (Patch)=true, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 87 | — | — | — | — | — | — | — | — | |
| k-NN + SUsing training-set Examples at test time (Ex)=true, Comparing images at the Image level (Img)=true, Comparing images at the Patch level (Patch)=false, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 86.88 | — | — | — | — | — | — | — | — | |
| ST-ProtoPNetUsing training-set Examples at test time (Ex)=false, Comparing images at the Image level (Img)=false, Comparing images at the Patch level (Patch)=true, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 86.6 | — | — | — | — | — | — | — | — | |
| TesNetUsing training-set Examples at test time (Ex)=false, Comparing images at the Image level (Img)=false, Comparing images at the Patch level (Patch)=true, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 86.5 | — | — | — | — | — | — | — | — | |
| Def-ProtoPNetUsing training-set Examples at test time (Ex)=false, Comparing images at the Image level (Img)=false, Comparing images at the Patch level (Patch)=true, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 86.4 | — | — | — | — | — | — | — | — | |
| ProtoPoolUsing training-set Examples at test time (Ex)=false, Comparing images at the Image level (Img)=false, Comparing images at the Patch level (Patch)=true, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 85.5 | — | — | — | — | — | — | — | — | |
| k-NN + cosineUsing training-set Examples at test time (Ex)=true, Comparing images at the Image level (Img)=true, Comparing images at the Patch level (Patch)=false, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 85.46 | — | — | — | — | — | — | — | — | |
| f-CBMModel backbone=CLIP-large (395M)2026.03 | 85.3 | — | — | — | — | — | 0.273 | 4.5 | 1 | |
| EMD-CorrUsing training-set Examples at test time (Ex)=true, Comparing images at the Image level (Img)=true, Comparing images at the Patch level (Patch)=true, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 84.98 | — | — | — | — | — | — | — | — | |
| CHM-CorrUsing training-set Examples at test time (Ex)=true, Comparing images at the Image level (Img)=true, Comparing images at the Patch level (Patch)=true, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 83.27 | — | — | — | — | — | — | — | — | |
| DARTBackbone=ResNet-50, Augmentation Strategy=Mixed Augmentations (MA)2023.02 | 82.83 | — | — | — | — | — | — | — | — | |
| DINOv2-S (LOES)Model=DINOv2-S, Selection Strategy=LOES2026.05 | 82.58 | — | — | — | — | — | — | — | — | |
| ProtoTreeUsing training-set Examples at test time (Ex)=false, Comparing images at the Image level (Img)=false, Comparing images at the Patch level (Patch)=true, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 82.2 | — | — | — | — | — | — | — | — | |
| PIPNetUsing training-set Examples at test time (Ex)=false, Comparing images at the Image level (Img)=false, Comparing images at the Patch level (Patch)=true, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 82 | — | — | — | — | — | — | — | — | |
| ERM + EMABackbone=ResNet-50, Augmentation Strategy=Mixed Augmentations (MA)2023.02 | 81.72 | — | — | — | — | — | — | — | — | |
| ViT-IN21k-B/16 (LOES)Model=ViT-IN21k-B/16, Selection Strategy=LOES2026.05 | 81.68 | — | — | — | — | — | — | — | — | |
| CGC2021.10 | 81.49 | — | — | — | — | — | — | — | — | |
| ProtoPNetUsing training-set Examples at test time (Ex)=false, Comparing images at the Image level (Img)=false, Comparing images at the Patch level (Patch)=true, Re-ranking initial predictions (R)=false, Backbone=ResNet-50, Pre-training=iNaturalist2023.08 | 81.1 | — | — | — | — | — | — | — | — | |
| Baseline2021.10 | 80.09 | — | — | — | — | — | — | — | — | |
| DINOv3-S/16 (LOES)Model=DINOv3-S/16, Selection Strategy=LOES2026.05 | 79.91 | — | — | — | — | — | — | — | — | |
| DARTBackbone=ResNet-50, Augmentation Strategy=Single Augmentation (SA)2023.02 | 79.75 | — | — | — | — | — | — | — | — | |
| f-CBMModel backbone=CLIP-base (110M)2026.03 | 79.3 | — | — | — | — | — | 0.2 | 2.6 | 0.6 | |
| ProtoPNet in Chen et al. (2019)Pre-trained=ImageNet2026.03 | 79.2 | — | — | — | — | — | — | — | — | |
| CNNPre-trained=ImageNet, Runs=52026.03 | 79.1 | — | — | — | — | — | — | — | — | |
| KMEx (K/C=5)Pre-trained=ImageNet, Runs=52026.03 | 78.6 | — | — | — | — | — | — | — | — | |
| ERM + EMABackbone=ResNet-50, Augmentation Strategy=Single Augmentation (SA)2023.02 | 78.55 | — | — | — | — | — | — | — | — | |
| CT-CBMModel backbone=CLIP-large (395M)2026.03 | 77.8 | — | — | — | — | — | 0.201 | 6.5 | 1.2 | |
| ICBMsBackbone=WideResNet2026.05 | 77.3 | — | — | — | — | — | — | — | — | |
| Label-freeModel backbone=CLIP-large (395M)2026.03 | 76.7 | — | — | — | — | — | 1.528 | 8.6 | 2.6 | |
| DeiT-B/16 (LOES)Model=DeiT-B/16, Selection Strategy=LOES2026.05 | 76.17 | — | — | — | — | — | — | — | — | |
| ViT-IN21k-B/16 (Last)Model=ViT-IN21k-B/16, Selection Strategy=Last Layer2026.05 | 76.02 | — | — | — | — | — | — | — | — | |
| LwFBackbone=VGG-16, Resolution=224x2242022.03 | 75.23 | — | — | — | — | — | — | — | — | |
| B4Backbone=ResNet34, Pre-trained=ImageNet, Runs=52026.03 | 75.2 | — | — | — | — | — | — | — | — | |
| DINOv2-S (Last)Model=DINOv2-S, Selection Strategy=Last Layer2026.05 | 75.1 | — | — | — | — | — | — | — | — | |
| NED2020.06 | 74.9 | 2.4 | — | — | — | — | — | — | — | |
| EWCBackbone=VGG-16, Resolution=224x224, lambda=0.5k2022.03 | 74.72 | — | — | — | — | — | — | — | — | |
| FinetuningBackbone=VGG-16, Resolution=224x2242022.03 | 74.39 | — | — | — | — | — | — | — | — | |
| WkNNvariant=[9]2020.06 | 74.3 | 20.5 | — | — | — | — | — | — | — | |
| WkNNvariant=[16]2020.06 | 74.3 | 20.7 | — | — | — | — | — | — | — | |
| KNN2020.06 | 73.8 | 9.2 | — | — | — | — | — | — | — | |
| CBMsBackbone=WideResNet2026.05 | 72.5 | — | — | — | — | — | — | — | — | |
| Indep.-CBMModel backbone=CLIP-large (395M)2026.03 | 72.3 | — | — | — | — | — | 0.081 | 2.5 | 0.6 | |
| EWCBackbone=VGG-16, Resolution=224x224, lambda=8k2022.03 | 71.44 | — | — | — | — | — | — | — | — | |
| DINOv3-S/16 (Last)Model=DINOv3-S/16, Selection Strategy=Last Layer2026.05 | 70.86 | — | — | — | — | — | — | — | — | |
| MixMatchSamples/Class=30, Backbone=ResNet-502020.03 | 70.41 | — | — | — | — | — | — | — | — | |
| CT-CBMModel backbone=CLIP-base (110M)2026.03 | 70.2 | — | — | — | — | — | 0.221 | 2.9 | 0.7 | |
| Label-freeModel backbone=CLIP-base (110M)2026.03 | 69.8 | — | — | — | — | — | 1.404 | 6.3 | 2.5 | |
| Calibration w/ ADAMAB# Params=+0.664M, Setting=Zero-shot, Backbone=CLIP-ViT-Large2026.02 | 68.6 | — | — | — | — | — | — | — | — | |
| 1NNsource=reported2020.06 | 67.6 | — | — | — | — | — | — | — | — | |
| 1NNsource=re-implemented2020.06 | 67.2 | — | — | — | — | — | — | — | — | |
| ProtoPNetPre-trained=ImageNet, Runs=52026.03 | 66.4 | — | — | — | — | — | — | — | — | |
| Indep.-CBMModel backbone=CLIP-base (110M)2026.03 | 66.2 | — | — | — | — | — | 0.121 | 3.2 | 1.2 | |
| NAVESetting=N34, Backbone=ResNet502024.11 | 66 | — | — | — | — | — | — | — | — | |
| DeiT-B/16 (Last)Model=DeiT-B/16, Selection Strategy=Last Layer2026.05 | 65.45 | — | — | — | — | — | — | — | — | |
| Concept Matrix Search2024.04 | 65.17 | — | — | — | — | — | — | — | — | |
| Calibration w/ ADAMAB# Params=+1.180M, Setting=Zero-shot, Backbone=Voyage-multimodal-32026.02 | 65.04 | — | — | — | — | — | — | — | — | |
| Calibration w/ random aug.# Params=+0.664M, Setting=Zero-shot, Backbone=CLIP-ViT-Large2026.02 | 64.96 | — | — | — | — | — | — | — | — | |
| DescriptionCLS2024.04 | 63.46 | — | — | — | — | — | — | — | — | |
| Zero-Shot CLIPMode=Zero-shot2024.04 | 62.63 | — | — | — | — | — | — | — | — | |
| Calibration w/ only init set# Params=+0.664M, Setting=Zero-shot, Backbone=CLIP-ViT-Large2026.02 | 62.44 | — | — | — | — | — | — | — | — | |
| [29]Samples/Class=30, Backbone=ResNet-502020.03 | 62.25 | — | — | — | — | — | — | — | — | |
| VS2++Backbone=ViT-B/16, Steering Setting=RAG-enhanced (oracle unlabeled external data)2025.06 | 61.91 | — | — | — | — | — | — | — | — | |
| NAVESetting=N4, Backbone=ResNet502024.11 | 61.6 | — | — | — | — | — | — | — | — | |
| CLIP Steering VectorBackbone=ViT-B/16, Steering Setting=RAG-enhanced (oracle unlabeled external data)2025.06 | 61.51 | — | — | — | — | — | — | — | — | |
| Calibration w/ random aug.# Params=+1.180M, Setting=Zero-shot, Backbone=Voyage-multimodal-32026.02 | 61.01 | — | — | — | — | — | — | — | — | |
| Weighted RAGBackbone=ViT-B/16, Steering Setting=RAG-enhanced (oracle unlabeled external data)2025.06 | 60.65 | — | — | — | — | — | — | — | — | |
| MixMatchSamples/Class=20, Backbone=ResNet-502020.03 | 60.57 | — | — | — | — | — | — | — | — | |
| Gemini2.0-Flash-Lite# Params=n/a, Setting=Zero-shot2026.02 | 60.07 | — | — | — | — | — | — | — | — | |
| VS2++Backbone=ViT-B/32, Steering Setting=RAG-enhanced (oracle unlabeled external data)2025.06 | 58.84 | — | — | — | — | — | — | — | — | |
| Net2VecBackbone=ResNet502024.11 | 58.5 | — | — | — | — | — | — | — | — | |
| Weighted RAGBackbone=ViT-B/32, Steering Setting=RAG-enhanced (oracle unlabeled external data)2025.06 | 58.32 | — | — | — | — | — | — | — | — | |
| CRAFTBackbone=ResNet502024.11 | 57.2 | — | — | — | — | — | — | — | — | |
| VS2++Backbone=ViT-B/16, Steering Setting=RAG-enhanced (non-oracle unlabeled external data)2025.06 | 57.02 | — | — | — | — | — | — | — | — | |
| ResNet50Backbone=ResNet502024.11 | 56.8 | — | — | — | — | — | — | — | — | |
| CLIP Steering VectorBackbone=ViT-B/32, Steering Setting=RAG-enhanced (oracle unlabeled external data)2025.06 | 56.42 | — | — | — | — | — | — | — | — | |
| VS2Backbone=ViT-B/16, Steering Setting=Label-free, unsupervised steering2025.06 | 56.14 | — | — | — | — | — | — | — | — | |
| Label-free CBMsBackbone=WideResNet2026.05 | 55.7 | — | — | — | — | — | — | — | — | |
| CLIPZSBackbone=ViT-B/16, Steering Setting=Label-free, unsupervised steering2025.06 | 55.06 | — | — | — | — | — | — | — | — | |
| NAVESetting=N234, Backbone=ResNet502024.11 | 54.6 | — | — | — | — | — | — | — | — | |
| CLIP Steering VectorBackbone=ViT-B/16, Steering Setting=RAG-enhanced (non-oracle unlabeled external data)2025.06 | 53.95 | — | — | — | — | — | — | — | — | |
| SAEF+γ RECBackbone=ViT-B/16, Steering Setting=Label-free, unsupervised steering2025.06 | 53.28 | — | — | — | — | — | — | — | — | |
| VS2++Backbone=ViT-B/32, Steering Setting=RAG-enhanced (non-oracle unlabeled external data)2025.06 | 52.81 | — | — | — | — | — | — | — | — | |
| B234Pre-trained=ImageNet, Runs=52026.03 | 52.8 | — | — | — | — | — | — | — | — | |
| VS2Backbone=ViT-B/32, Steering Setting=Label-free, unsupervised steering2025.06 | 52.69 | — | — | — | — | — | — | — | — | |
| [29]Samples/Class=20, Backbone=ResNet-502020.03 | 52 | — | — | — | — | — | — | — | — | |
| SAEA RECBackbone=ViT-B/16, Steering Setting=Label-free, unsupervised steering2025.06 | 51.81 | — | — | — | — | — | — | — | — | |
| CLIPZSBackbone=ViT-B/32, Steering Setting=Label-free, unsupervised steering2025.06 | 51.76 | — | — | — | — | — | — | — | — | |
| SAEF RECBackbone=ViT-B/16, Steering Setting=Label-free, unsupervised steering2025.06 | 51.43 | — | — | — | — | — | — | — | — | |
| Calibration w/ only init set# Params=+1.180M, Setting=Zero-shot, Backbone=Voyage-multimodal-32026.02 | 50.02 | — | — | — | — | — | — | — | — | |
| Teacher2021.10 | 49.41 | — | — | — | — | — | — | — | — | |
| SAEF+γ RECBackbone=ViT-B/32, Steering Setting=Label-free, unsupervised steering2025.06 | 49.41 | — | — | — | — | — | — | — | — | |
| SAEF RECBackbone=ViT-B/32, Steering Setting=Label-free, unsupervised steering2025.06 | 48.08 | — | — | — | — | — | — | — | — | |
| CLIP Steering VectorBackbone=ViT-B/32, Steering Setting=RAG-enhanced (non-oracle unlabeled external data)2025.06 | 47.89 | — | — | — | — | — | — | — | — | |
| SAEA RECBackbone=ViT-B/32, Steering Setting=Label-free, unsupervised steering2025.06 | 47.45 | — | — | — | — | — | — | — | — | |
| Student2021.10 | 41.44 | — | — | — | — | — | — | — | — | |
| Llama-3.2# Params=90B, Setting=Zero-shot2026.02 | 40.06 | — | — | — | — | — | — | — | — | |
| Mistral-Small# Params=24B, Setting=Zero-shot2026.02 | 38.93 | — | — | — | — | — | — | — | — |