Image Classification on ImageNet OOD variants (A, V2, R, S) 1k (test val)
77.87Top-1 Acc (ImageNet)DPE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DPEBackbone=ViT-L/14, Evaluation Protocol=Zero-shot / TTA2024.10 | 77.87 | 61.09 | 70.83 | 89.18 | 66.33 | 73.06 | 71.86 | |
| TDABackbone=ViT-L/14, Evaluation Protocol=Zero-shot / TTA2024.10 | 76.28 | 61.27 | 68.42 | 88.41 | 64.67 | 71.81 | 70.69 | |
| DiffTPT + CoOpBackbone=ViT-B/16, Evaluation Protocol=16-shot prompt learning2024.10 | 75 | 58.09 | 66.8 | 73.9 | 49.5 | 64.12 | 61.97 | |
| OpenCLIPBackbone=ViT-L/14, Evaluation Protocol=Zero-shot2024.10 | 74.04 | 53.88 | 67.69 | 87.42 | 63.18 | 69.31 | 68.13 | |
| DPE + CoOpBackbone=ViT-B/16, Evaluation Protocol=16-shot prompt learning2024.10 | 73.67 | 59.43 | 66.38 | 78.49 | 50.78 | 65.75 | 63.77 | |
| TPT + CoOpBackbone=ViT-B/16, Evaluation Protocol=16-shot prompt learning2024.10 | 73.61 | 57.95 | 66.83 | 77.27 | 49.29 | 64.99 | 62.83 | |
| DPEBackbone=ViT-B/16, Evaluation Protocol=Zero-shot / TTA2024.10 | 71.91 | 59.63 | 65.44 | 80.4 | 52.26 | 65.93 | 64.43 | |
| CoOpBackbone=ViT-B/16, Evaluation Protocol=16-shot prompt learning2024.10 | 71.51 | 49.71 | 64.2 | 75.21 | 47.99 | 61.72 | 59.28 | |
| DiffTPTBackbone=ViT-B/16, Evaluation Protocol=Zero-shot / TTA2024.10 | 70.3 | 55.68 | 65.1 | 75 | 46.8 | 62.28 | 60.52 | |
| TDABackbone=ViT-B/16, Evaluation Protocol=Zero-shot / TTA2024.10 | 69.51 | 60.11 | 64.67 | 80.24 | 50.54 | 65.01 | 63.89 | |
| TPTBackbone=ViT-B/16, Evaluation Protocol=Zero-shot / TTA2024.10 | 68.98 | 54.77 | 63.45 | 77.06 | 47.94 | 62.44 | 60.81 | |
| EnsembleBackbone=ViT-B/16, Evaluation Protocol=Zero-shot2024.10 | 68.34 | 49.89 | 61.88 | 77.65 | 48.24 | 61.2 | 59.42 | |
| CLIPBackbone=ViT-B/16, Evaluation Protocol=Zero-shot2024.10 | 66.73 | 47.87 | 60.86 | 73.98 | 46.09 | 59.11 | 57.2 | |
| DPE + CoOpBackbone=ResNet-50, Evaluation Protocol=16-shot prompt learning2024.10 | 64.86 | 30.08 | 57.96 | 59.78 | 37.8 | 50.1 | 46.41 | |
| TPT + CoOpBackbone=ResNet-50, Evaluation Protocol=16-shot prompt learning2024.10 | 64.73 | 30.32 | 57.83 | 58.99 | 35.86 | 49.55 | 45.75 | |
| DiffTPT + CoOpBackbone=ResNet-50, Evaluation Protocol=16-shot prompt learning2024.10 | 64.7 | 32.96 | 61.7 | 58.2 | 36.8 | 50.87 | 47.42 | |
| DPEBackbone=ResNet-50, Evaluation Protocol=Zero-shot / TTA2024.10 | 63.41 | 30.15 | 56.72 | 63.72 | 40.03 | 50.81 | 47.66 | |
| CoOpBackbone=ResNet-50, Evaluation Protocol=16-shot prompt learning2024.10 | 63.33 | 23.06 | 55.4 | 56.6 | 34.67 | 46.61 | 42.43 | |
| TDABackbone=ResNet-50, Evaluation Protocol=Zero-shot / TTA2024.10 | 61.35 | 30.29 | 55.54 | 62.58 | 38.12 | 49.58 | 46.63 | |
| DiffTPTBackbone=ResNet-50, Evaluation Protocol=Zero-shot / TTA2024.10 | 60.8 | 31.06 | 55.8 | 58.8 | 37.1 | 48.71 | 45.69 | |
| TPTBackbone=ResNet-50, Evaluation Protocol=Zero-shot / TTA2024.10 | 60.74 | 26.67 | 54.7 | 59.11 | 35.09 | 47.26 | 43.89 | |
| EnsembleBackbone=ResNet-50, Evaluation Protocol=Zero-shot2024.10 | 59.81 | 23.24 | 52.91 | 60.72 | 35.48 | 46.43 | 43.09 | |
| CLIPBackbone=ResNet-50, Evaluation Protocol=Zero-shot2024.10 | 58.16 | 21.83 | 51.41 | 56.15 | 33.37 | 44.18 | 40.69 |