Image Classification on ImageNet Domain Generalization OOD Variants (test)
77.87ImageNet AccDPE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DPEBackbone=ViT-L/14, Protocol=Zero-shot2024.10 | 77.87 | 70.83 | 66.33 | 61.09 | 89.18 | 73.06 | 71.86 | |
| TDABackbone=ViT-L/14, Protocol=Zero-shot2024.10 | 76.28 | 68.42 | 64.67 | 61.27 | 88.41 | 71.81 | 70.69 | |
| DiffTPT + CoOpBackbone=ViT-B/16, Protocol=16-shot2024.10 | 75 | 66.8 | 49.5 | 58.09 | 73.9 | 64.12 | 61.97 | |
| OpenCLIP (ViT-L/14)Backbone=ViT-L/14, Protocol=Zero-shot2024.10 | 74.04 | 67.69 | 63.18 | 53.88 | 87.42 | 69.31 | 68.13 | |
| DPE + CoOpBackbone=ViT-B/16, Protocol=16-shot2024.10 | 73.67 | 66.38 | 50.78 | 59.43 | 78.49 | 65.75 | 63.77 | |
| TPT + CoOpBackbone=ViT-B/16, Protocol=16-shot2024.10 | 73.61 | 66.83 | 49.29 | 57.95 | 77.27 | 64.99 | 62.83 | |
| DroPLe2025.12 | 71.94 | 64.9 | 50.36 | 51.33 | 77.59 | — | 61.05 | |
| DPEBackbone=ViT-B/16, Protocol=Zero-shot2024.10 | 71.91 | 65.44 | 52.26 | 59.63 | 80.4 | 65.93 | 64.43 | |
| DPEBackbone=ViT-B/16, Adaptation Protocol=Backpropagation-Based2026.04 | 71.91 | 65.44 | 52.26 | 59.63 | 80.4 | 65.93 | 64.43 | |
| HPTShots=16, Epochs=3, Batch Size=82023.12 | 71.72 | 65.25 | 49.36 | 50.85 | 77.38 | 60.71 | — | |
| CoOpShots=16, Epochs=3, Batch Size=82023.12 | 71.51 | 64.2 | 47.99 | 49.71 | 75.21 | 59.28 | — | |
| CoOpBackbone=ViT-B/16, Protocol=16-shot2024.10 | 71.51 | 64.2 | 47.99 | 49.71 | 75.21 | 61.72 | 59.28 | |
| CoOpBackbone=ViT-B/16, Mode=Train-time adaptation2026.01 | 71.51 | 64.2 | 47.99 | 49.71 | 75.21 | — | 59.28 | |
| ProMetaR2025.12 | 71.29 | 64.39 | 49.55 | 51.25 | 77.89 | — | 60.77 | |
| PSRC2025.12 | 71.27 | 64.35 | 49.55 | 50.9 | 77.8 | — | 60.65 | |
| KgCoOp2025.12 | 71.2 | 64.1 | 48.97 | 50.69 | 76.7 | — | 60.11 | |
| GalLoPReproduced=true2025.12 | 71.14 | 64.32 | 49.56 | 50.83 | 77.42 | — | 60.53 | |
| CoCoOpShots=16, Epochs=3, Batch Size=82023.12 | 71.02 | 64.07 | 48.75 | 50.63 | 76.18 | 59.9 | — | |
| CoCoOpBackbone=ViT-B/16, Mode=Train-time adaptation2026.01 | 71.02 | 64.07 | 48.75 | 50.63 | 76.18 | — | 59.91 | |
| CoPrompt2025.12 | 70.8 | 64.25 | 49.43 | 50.5 | 77.51 | — | 60.42 | |
| Tip-AdapterBackbone=ViT-B/162026.01 | 70.75 | 63.41 | 48.88 | 51.04 | 77.76 | — | 60.27 | |
| MaPLeShots=16, Epochs=3, Batch Size=82023.12 | 70.72 | 64.07 | 49.15 | 50.9 | 76.98 | 60.26 | — | |
| TaTaBackbone=ViT-B/16, Mode=Test-time adaptation2026.01 | 70.63 | 65.37 | 52.39 | 61.87 | 81.78 | — | 65.28 | |
| GS-BiasBackbone=ViT-B/16, Adaptation Protocol=Backpropagation-Based2026.04 | 70.57 | 64.62 | 50.33 | 56.61 | 80.49 | 64.52 | 63.01 | |
| ADAPT†Backbone=ViT-B/16, Adaptation Protocol=Backpropagation-Free2026.04 | 70.55 | 64.44 | 51.49 | 60.87 | 80.85 | 65.64 | 64.41 | |
| DiffTPTBackbone=ViT-B/16, Protocol=Zero-shot2024.10 | 70.3 | 65.1 | 46.8 | 55.68 | 75 | 62.28 | 60.52 | |
| DiffTPTBackbone=ViT-B/16, Mode=Test-time adaptation2026.01 | 70.3 | 65.1 | 46.8 | 55.68 | 75 | — | 60.52 | |
| DiffTPTBackbone=ViT-B/16, Adaptation Protocol=Backpropagation-Based2026.04 | 70.3 | 65.1 | 46.8 | 55.68 | 75 | 62.28 | 60.52 | |
| PTABackbone=ViT-B/16, Adaptation Protocol=Backpropagation-Free2026.04 | 70.28 | 64.85 | 51 | 61.15 | 80.79 | 65.61 | 64.45 | |
| BCABackbone=ViT-B/16, Adaptation Protocol=Backpropagation-Free2026.04 | 70.22 | 64.9 | 50.87 | 61.14 | 80.72 | 65.37 | 64.16 | |
| SCA†Backbone=ViT-B/16, Adaptation Protocol=Backpropagation-Free2026.04 | 70.21 | 64.01 | 51.11 | 61.13 | 80.93 | 65.48 | 64.3 | |
| MTABackbone=ViT-B/16, Adaptation Protocol=Backpropagation-Free2026.04 | 70.08 | 64.24 | 49.61 | 58.06 | 78.33 | 64.06 | 62.56 | |
| SPTR2025.12 | 70.05 | 64.4 | 48.78 | 51.3 | 77.9 | — | 60.59 | |
| TDABackbone=ViT-B/16, Protocol=Zero-shot2024.10 | 69.51 | 64.67 | 50.54 | 60.11 | 80.24 | 65.01 | 63.89 | |
| TDABackbone=ViT-B/16, Mode=Test-time adaptation2026.01 | 69.51 | 64.67 | 50.54 | 60.11 | 80.24 | — | 63.89 | |
| TDABackbone=ViT-B/16, Adaptation Protocol=Backpropagation-Free2026.04 | 69.51 | 64.67 | 50.54 | 60.11 | 80.24 | 65.01 | 63.89 | |
| TPTBackbone=ViT-B/16, Protocol=Zero-shot2024.10 | 68.98 | 63.45 | 47.94 | 54.77 | 77.06 | 62.44 | 60.81 | |
| TPTBackbone=ViT-B/16, Mode=Test-time adaptation2026.01 | 68.98 | 63.45 | 47.94 | 54.77 | 77.06 | — | 60.81 | |
| TPTBackbone=ViT-B/16, Adaptation Protocol=Backpropagation-Based2026.04 | 68.98 | 63.45 | 47.94 | 54.77 | 77.06 | 62.44 | 60.81 | |
| EnsembleBackbone=ViT-B/16, Protocol=Zero-shot2024.10 | 68.34 | 61.88 | 48.24 | 49.89 | 77.65 | 61.2 | 59.42 | |
| CLIPBackbone=ViT-B/162026.01 | 68.34 | 61.88 | 48.24 | 49.89 | 77.65 | — | 59.42 | |
| CLIPPrompting=Hand-crafted, Setting=Zero-shot2023.12 | 66.73 | 60.83 | 46.15 | 47.77 | 73.96 | 57.17 | — | |
| CLIP-ViT-B/16Backbone=ViT-B/16, Protocol=Zero-shot2024.10 | 66.73 | 60.86 | 46.09 | 47.87 | 73.98 | 59.11 | 57.2 | |
| CLIP-ViT-B/16Backbone=ViT-B/162026.04 | 66.73 | 60.86 | 46.09 | 47.87 | 73.98 | 57.2 | 59.11 | |
| DPE + CoOpBackbone=ResNet-50, Protocol=16-shot2024.10 | 64.86 | 57.96 | 37.8 | 30.08 | 59.78 | 50.1 | 46.41 | |
| TPT + CoOpBackbone=ResNet-50, Protocol=16-shot2024.10 | 64.73 | 57.83 | 35.86 | 30.32 | 58.99 | 49.55 | 45.75 | |
| DiffTPT + CoOpBackbone=ResNet-50, Protocol=16-shot2024.10 | 64.7 | 61.7 | 36.8 | 32.96 | 58.2 | 50.87 | 47.42 | |
| DPEBackbone=ResNet-50, Protocol=Zero-shot2024.10 | 63.41 | 56.72 | 40.03 | 30.15 | 63.72 | 50.81 | 47.66 | |
| CoOpBackbone=ResNet-50, Protocol=16-shot2024.10 | 63.33 | 55.4 | 34.67 | 23.06 | 56.6 | 46.61 | 42.43 | |
| TDABackbone=ResNet-50, Protocol=Zero-shot2024.10 | 61.35 | 55.54 | 38.12 | 30.29 | 62.58 | 49.58 | 46.63 | |
| DiffTPTBackbone=ResNet-50, Protocol=Zero-shot2024.10 | 60.8 | 55.8 | 37.1 | 31.06 | 58.8 | 48.71 | 45.69 | |
| TPTBackbone=ResNet-50, Protocol=Zero-shot2024.10 | 60.74 | 54.7 | 35.09 | 26.67 | 59.11 | 47.26 | 43.89 | |
| EnsembleBackbone=ResNet-50, Protocol=Zero-shot2024.10 | 59.81 | 52.91 | 35.48 | 23.24 | 60.72 | 46.43 | 43.09 | |
| CLIP-ResNet-50Backbone=ResNet-50, Protocol=Zero-shot2024.10 | 58.16 | 51.41 | 33.37 | 21.83 | 56.15 | 44.18 | 40.69 |