Image Classification on ImageNet-S
65.41Top-1 AccBCA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BCAVisual backbone=ViT-L/142025.03 | 65.41 | — | |
| TDAVisual backbone=ViT-L/142025.03 | 64.67 | — | |
| CLIPVisual backbone=ViT-L/142025.03 | 63.18 | — | |
| PEFTShots=102023.05 | 61.1 | — | |
| PEFTShots=52023.05 | 55.3 | — | |
| WISE-FTBackbone=ViT-B/16, Perturbation=Clean2026.03 | 51.6 | — | |
| Any-shift Prompting + TPTTest-time optimization=true, Backbone=ViT-B/162024.02 | 50.83 | — | |
| ITOZero-shot=true, Backbone=ViT-B/16, Pre-training Dataset=Laion100M, Epochs=302026.03 | 50.2 | — | |
| TPGMBackbone=ViT-B/16, Perturbation=Clean2026.03 | 50.2 | — | |
| Any-shift PromptingTest-time optimization=false, Backbone=ViT-B/162024.02 | 49.8 | — | |
| SPDBackbone=ViT-B/16, Perturbation=Clean2026.03 | 49.8 | — | |
| FLYPBackbone=ViT-B/16, Perturbation=Clean2026.03 | 49.6 | — | |
| GRACEBackbone=ViT-B/16, Perturbation=Clean2026.03 | 49.3 | — | |
| CoOp + TPTTest-time optimization=true, Backbone=ViT-B/162024.02 | 49.29 | — | |
| BPLTest-time optimization=false, Backbone=ViT-B/162024.02 | 49.2 | — | |
| CoOpShots=102023.05 | 49.1 | — | |
| CoCoOpTest-time optimization=false, Backbone=ViT-B/162024.02 | 48.75 | — | |
| CoCoOp + TPTTest-time optimization=true, Backbone=ViT-B/162024.02 | 48.47 | — | |
| CLIPBackbone=ViT-B/16, Perturbation=Clean2026.03 | 48.3 | — | |
| CoOpTest-time optimization=false, Backbone=ViT-B/162024.02 | 47.99 | — | |
| TPTTest-time optimization=true, Backbone=ViT-B/162024.02 | 47.94 | — | |
| CoOpShots=52023.05 | 46.5 | — | |
| CLIPTest-time optimization=false, Backbone=ViT-B/162024.02 | 46.15 | — | |
| RandAR XL/162026.03 | 45.9 | — | |
| MAEtraining_mode=fine-tuned2024.11 | 45.2 | — | |
| Vanilla FTBackbone=ViT-B/16, Perturbation=Clean2026.03 | 45.1 | — | |
| CLIPZero-shot=true, Backbone=ViT-B/16, Pre-training Dataset=Laion100M, Epochs=302026.03 | 44.1 | — | |
| Attention Copytraining_mode=copy2024.11 | 43.1 | — | |
| Attention Distillationtraining_mode=distill2024.11 | 42.9 | — | |
| LaFTerShots=02023.05 | 42.7 | — | |
| DREAMEvaluation Protocol=Fine-tuning2026.03 | 42 | — | |
| SLIPZero-shot=true, Backbone=ViT-B/16, Pre-training Dataset=Laion100M, Epochs=302026.03 | 41.7 | — | |
| CLIPEvaluation Protocol=Fine-tuning2026.03 | 40.8 | — | |
| RandAR L/162026.03 | 40.6 | — | |
| CoOpShots=12023.05 | 39.9 | — | |
| PEFTShots=12023.05 | 38.5 | — | |
| ITO sub2Pre-training Dataset=CC12M, Backbone=ViT-B/16, Epochs=30, Evaluation protocol=Zero-shot2026.03 | 38.4 | — | |
| PMG-AFTBackbone=ViT-B/16, Perturbation=Clean2026.03 | 38.4 | — | |
| MAEtraining_mode=scratch2024.11 | 38 | — | |
| REPAEvaluation Protocol=Fine-tuning2026.03 | 37.2 | — | |
| LAATBackbone=ViT-B/16, Perturbation=Clean2026.03 | 36.8 | — | |
| ITOPre-training Dataset=CC12M, Backbone=ViT-B/16, Epochs=30, Evaluation protocol=Zero-shot2026.03 | 36 | — | |
| FAREBackbone=ViT-B/16, Perturbation=Clean2026.03 | 35.4 | — | |
| AnchoringModel=SWINv2-B, Number of Parameters=87.8M2024.06 | 33.42 | — | |
| ProposedModel=SWINv2-B, Number of Parameters=87.8M2024.06 | 33.34 | — | |
| Reference Masking RegularizationBackbone=SWINv2-B, Parameters=87.8M2024.06 | 33.34 | — | |
| ProposedModel=SWINv2-S, Number of Parameters=49.7M2024.06 | 33.3 | — | |
| Reference Masking RegularizationBackbone=SWINv2-S, Parameters=49.7M2024.06 | 33.3 | — | |
| ProposedModel=VITb16, Number of Parameters=86.6M2024.06 | 33 | — | |
| Reference Masking RegularizationBackbone=VITb16, Parameters=86.3M2024.06 | 33 | — | |
| AnchoringModel=VITb16, Number of Parameters=86.6M2024.06 | 32.32 | — | |
| StandardModel=SWINv2-S, Number of Parameters=49.7M2024.06 | 32.25 | — | |
| StandardBackbone=SWINv2-S, Parameters=49.7M2024.06 | 32.25 | — | |
| TeCoABackbone=ViT-B/16, Perturbation=Clean2026.03 | 32.1 | — | |
| AnchoringModel=SWINv2-S, Number of Parameters=49.7M2024.06 | 32.08 | — | |
| StandardModel=SWINv2-B, Number of Parameters=87.8M2024.06 | 31.91 | — | |
| StandardBackbone=SWINv2-B, Parameters=87.8M2024.06 | 31.91 | — | |
| ResNet-1512026.03 | 30.8 | — | |
| FLAIRPre-training Dataset=CC12M, Backbone=ViT-B/16, Epochs=30, Evaluation protocol=Zero-shot2026.03 | 30.2 | — | |
| StandardModel=VITb16, Number of Parameters=86.6M2024.06 | 29.4 | — | |
| StandardBackbone=VITb16, Parameters=86.3M2024.06 | 29.4 | — | |
| MAREvaluation Protocol=Fine-tuning2026.03 | 29.4 | — | |
| SLIPPre-training Dataset=CC12M, Backbone=ViT-B/16, Epochs=30, Evaluation protocol=Zero-shot2026.03 | 28.8 | — | |
| SigLIPPre-training Dataset=CC12M, Backbone=ViT-B/16, Epochs=30, Evaluation protocol=Zero-shot2026.03 | 28.7 | — | |
| FLUIDEvaluation Protocol=Fine-tuning2026.03 | 28.6 | — | |
| ResNet-1012026.03 | 27.8 | — | |
| ProposedModel=SWINv2-T, Number of Parameters=28.4M2024.06 | 27.68 | — | |
| Reference Masking RegularizationBackbone=SWINv2-T, Parameters=28.4M2024.06 | 27.68 | — | |
| AnchoringModel=SWINv2-T, Number of Parameters=28.4M2024.06 | 27.56 | — | |
| StandardModel=SWINv2-T, Number of Parameters=28.4M2024.06 | 27.08 | — | |
| StandardBackbone=SWINv2-T, Parameters=28.4M2024.06 | 27.08 | — | |
| ResNet-502026.03 | 26 | — | |
| CLIPPre-training Dataset=CC12M, Backbone=ViT-B/16, Epochs=30, Evaluation protocol=Zero-shot2026.03 | 24.5 | — | |
| ResNet-342026.03 | 24.3 | — | |
| GRACEBackbone=ViT-B/16, Perturbation=Adversarial, Adversarial Attack Parameters=AutoAttack APGD-CE, ϵ=4/2552026.03 | 22.3 | — | |
| ResNet-182026.03 | 21.2 | — | |
| PMG-AFTBackbone=ViT-B/16, Perturbation=Adversarial, Adversarial Attack Parameters=AutoAttack APGD-CE, ϵ=4/2552026.03 | 18.5 | — | |
| TeCoABackbone=ViT-B/16, Perturbation=Adversarial, Adversarial Attack Parameters=AutoAttack APGD-CE, ϵ=4/2552026.03 | 16.8 | — | |
| ITOPre-train dataset=CC3M, Backbone=ViT-B/16, Training Epochs=30, Evaluation Protocol=Zero-shot2026.03 | 16.2 | — | |
| ITO sub2Pre-train dataset=CC3M, Backbone=ViT-B/16, Training Epochs=30, Evaluation Protocol=Zero-shot2026.03 | 16.2 | — | |
| LAATBackbone=ViT-B/16, Perturbation=Adversarial, Adversarial Attack Parameters=AutoAttack APGD-CE, ϵ=4/2552026.03 | 15.6 | — | |
| FAREBackbone=ViT-B/16, Perturbation=Adversarial, Adversarial Attack Parameters=AutoAttack APGD-CE, ϵ=4/2552026.03 | 14.2 | — | |
| FLAIRPre-train dataset=CC3M, Backbone=ViT-B/16, Training Epochs=30, Evaluation Protocol=Zero-shot2026.03 | 8.5 | — | |
| SLIPPre-train dataset=CC3M, Backbone=ViT-B/16, Training Epochs=30, Evaluation Protocol=Zero-shot2026.03 | 8.1 | — | |
| SigLIPPre-train dataset=CC3M, Backbone=ViT-B/16, Training Epochs=30, Evaluation Protocol=Zero-shot2026.03 | 7.6 | — | |
| CLIPPre-train dataset=CC3M, Backbone=ViT-B/16, Training Epochs=30, Evaluation Protocol=Zero-shot2026.03 | 6 | — | |
| CLIPBackbone=ViT-B/16, Perturbation=Adversarial, Adversarial Attack Parameters=AutoAttack APGD-CE, ϵ=4/2552026.03 | 0 | — | |
| Vanilla FTBackbone=ViT-B/16, Perturbation=Adversarial, Adversarial Attack Parameters=AutoAttack APGD-CE, ϵ=4/2552026.03 | 0 | — | |
| WISE-FTBackbone=ViT-B/16, Perturbation=Adversarial, Adversarial Attack Parameters=AutoAttack APGD-CE, ϵ=4/2552026.03 | 0 | — | |
| FLYPBackbone=ViT-B/16, Perturbation=Adversarial, Adversarial Attack Parameters=AutoAttack APGD-CE, ϵ=4/2552026.03 | 0 | — | |
| TPGMBackbone=ViT-B/16, Perturbation=Adversarial, Adversarial Attack Parameters=AutoAttack APGD-CE, ϵ=4/2552026.03 | 0 | — | |
| SPDBackbone=ViT-B/16, Perturbation=Adversarial, Adversarial Attack Parameters=AutoAttack APGD-CE, ϵ=4/2552026.03 | 0 | — | |
| CLIPshot=16-shot, epochs=32026.03 | — | 46.2 | |
| CLIPPrompts=Hand-crafted, Tuned=false2026.05 | — | 46.15 | |
| CLIP-EPrompts=Hand-crafted, Tuned=false2026.05 | — | 47.87 | |
| CLIP-MoEshot=16-shot, epochs=32026.03 | — | 57.4 | |
| CLIP-MoE + Det-FTshot=16-shot, epochs=32026.03 | — | 57 | |
| CLIP-MoE + MoE-GRPOshot=16-shot, epochs=32026.03 | — | 59 | |
| CoCoOpshot=16-shot, epochs=32026.03 | — | 48.8 | |
| CoCoOpPrompts=VP+TP, Tuned=true2026.05 | — | 48.75 |