Image Classification on ImageNet A, R, S V2 (test)
64.63Accuracy (ImageNet-A)MS-TTA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MS-TTABackbone=ViT-B/16, training-free=true2025.07 | 64.63 | 81.08 | 51.55 | 65.57 | 65.71 | — | |
| BoostAdapterBackbone=ViT-B/16, training-free=true2025.07 | 64.53 | 80.95 | 51.28 | 65.51 | 65.57 | — | |
| ZERO ens (w/ logits)#API=448, Backbone=CLIP-B/162026.04 | 62.8 | 80.8 | 50.6 | 65.2 | 71.2 | 7 | |
| BETA#API=1, Backbone=CLIP-B/162026.04 | 62.8 | 76 | 50.9 | 65.1 | 77.5 | 7.4 | |
| BCABackbone=ViT-B/16, training-free=true2025.07 | 61.14 | 80.72 | 50.87 | 64.9 | 64.41 | — | |
| TDABackbone=ViT-B/16, training-free=true2025.07 | 60.11 | 80.24 | 50.54 | 64.67 | 63.89 | — | |
| DPEBackbone=ViT-B/162025.07 | 59.63 | 80.4 | 52.26 | 65.44 | 64.43 | — | |
| ZERO (w/ logits)#API=64, Backbone=CLIP-B/162026.04 | 59.6 | 77.2 | 48.4 | 64.2 | 69.3 | 4.6 | |
| MTA+EnsembleBackbone=ViT-B/162025.07 | 58.06 | 78.33 | 49.61 | 64.24 | 62.56 | — | |
| MTABackbone=ViT-B/162025.07 | 57.41 | 76.92 | 48.58 | 63.61 | 61.63 | — | |
| DiffTPTBackbone=ViT-B/162025.07 | 55.68 | 75 | 46.8 | 65.1 | 60.65 | — | |
| B²TPT (w/ tokens)#API=120, Backbone=CLIP-B/162026.04 | 55.3 | 78.6 | 49.5 | 65.4 | 69.6 | 4.6 | |
| TPTBackbone=ViT-B/162025.07 | 54.77 | 77.06 | 47.94 | 63.45 | 60.81 | — | |
| Tip-AdapterBackbone=ViT-B/162025.07 | 51.04 | 77.76 | 48.88 | 63.41 | 60.27 | — | |
| CoCoOpBackbone=ViT-B/162025.07 | 50.63 | 76.18 | 48.75 | 64.07 | 59.91 | — | |
| ZOO-SPSA-GC#API=16, Backbone=CLIP-B/162026.04 | 50.2 | 72.8 | 46 | 61.5 | 65.8 | 0.1 | |
| CLIPBackbone=ViT-B/162025.07 | 49.89 | 77.65 | 48.24 | 61.88 | 59.42 | — | |
| CoOpBackbone=ViT-B/162025.07 | 49.71 | 75.21 | 47.99 | 64.2 | 59.28 | — | |
| LAME#API=1, Backbone=CLIP-B/162026.04 | 48.1 | 72.8 | 45.4 | 61.6 | 66.7 | -0.2 | |
| Source#API=1, Backbone=CLIP-B/162026.04 | 47.9 | 74 | 46.1 | 60.9 | 66.7 | — | |
| MS-TTABackbone=ResNet50, training-free=true2025.07 | 35.62 | 62.84 | 39.1 | 56.58 | 48.54 | — | |
| MS-TTABackbone=ResNet-50, Training-free approach=true2025.07 | 35.62 | 62.84 | 39.1 | 56.58 | 48.54 | — | |
| BoostAdapterBackbone=ResNet50, training-free=true2025.07 | 35.12 | 62.66 | 38.87 | 56.14 | 48.2 | — | |
| BoostAdapterBackbone=ResNet-50, Training-free approach=true2025.07 | 35.12 | 62.66 | 38.87 | 56.14 | 48.2 | — | |
| DiffTPTBackbone=ResNet502025.07 | 31.06 | 58.8 | 37.1 | 55.8 | 45.69 | — | |
| DiffTPTBackbone=ResNet-50, Training-free approach=false2025.07 | 31.06 | 58.8 | 37.1 | 55.8 | 45.69 | — | |
| BCABackbone=ResNet50, training-free=true2025.07 | 30.35 | 62.89 | 38.08 | 56.58 | 46.98 | — | |
| BCABackbone=ResNet-50, Training-free approach=true2025.07 | 30.35 | 62.89 | 38.08 | 56.58 | 46.98 | — | |
| TDABackbone=ResNet50, training-free=true2025.07 | 30.29 | 62.58 | 38.12 | 55.54 | 46.63 | — | |
| TDABackbone=ResNet-50, Training-free approach=true2025.07 | 30.29 | 62.58 | 38.12 | 55.54 | 46.63 | — | |
| DPEBackbone=ResNet502025.07 | 30.15 | 63.72 | 40.03 | 56.72 | 47.66 | — | |
| DPEBackbone=ResNet-50, Training-free approach=false2025.07 | 30.15 | 63.72 | 40.03 | 56.72 | 47.66 | — | |
| TPTBackbone=ResNet502025.07 | 26.67 | 59.11 | 35.09 | 54.7 | 43.89 | — | |
| TPTBackbone=ResNet-50, Training-free approach=false2025.07 | 26.67 | 59.11 | 35.09 | 54.7 | 43.89 | — | |
| CoCoOpBackbone=ResNet502025.07 | 23.32 | 57.74 | 34.48 | 55.72 | 42.82 | — | |
| CoCoOpBackbone=ResNet-50, Training-free approach=false2025.07 | 23.32 | 57.74 | 34.48 | 55.72 | 42.82 | — | |
| CLIPBackbone=ResNet502025.07 | 23.24 | 60.72 | 35.48 | 52.91 | 43.09 | — | |
| CLIPBackbone=ResNet-50, Training-free approach=false2025.07 | 23.24 | 60.72 | 35.48 | 52.91 | 43.09 | — | |
| Tip-AdapterBackbone=ResNet502025.07 | 23.13 | 60.35 | 35.74 | 53.97 | 43.3 | — | |
| Tip-AdapterBackbone=ResNet-50, Training-free approach=false2025.07 | 23.13 | 60.35 | 35.74 | 53.97 | 43.3 | — | |
| CoOpBackbone=ResNet502025.07 | 23.06 | 56.6 | 34.67 | 55.4 | 42.43 | — | |
| CoOpBackbone=ResNet-50, Training-free approach=false2025.07 | 23.06 | 56.6 | 34.67 | 55.4 | 42.43 | — |