Domain Generalization on DomainBed (OH, TI, VLCS, PACS, DN) (test)
87.38Accuracy (OH)VL2V-SD
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VL2V-SDBackbone=ViT-B/16, Initialization=CLIP, Setting=White-Box, SWAD=true2023.10 | 87.38 | 58.54 | 83.25 | 96.68 | 62.79 | 89.99 | 77.73 | |
| WiSE-FTBackbone=ViT-B/16, Initialization=CLIP, Setting=White-Box, SWAD=false2023.10 | 86.32 | 54.5 | 82.88 | 97.29 | 58.01 | 88.35 | 75.8 | |
| VL2V-ADiPBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=true2023.10 | 85.74 | 55.43 | 81.9 | 94.94 | 59.38 | 89.02 | 75.48 | |
| MIROBackbone=ViT-B/16, Initialization=CLIP, Setting=White-Box, SWAD=true2023.10 | 84.8 | 59.3 | 82.3 | 96.44 | 60.47 | 91 | 76.66 | |
| VL2V-ADiPBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=false2023.10 | 84.56 | 49.99 | 81.53 | 93.41 | 56.82 | 88.74 | 73.26 | |
| DARTBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=true2023.10 | 83.75 | 49.68 | 77.29 | 90.55 | 58.05 | 88.54 | 71.86 | |
| RISEBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=true2023.10 | 83.48 | 52.55 | 83.7 | 93.54 | 56.58 | 88.91 | 73.97 | |
| SAGMBackbone=ViT-B/16, Initialization=CLIP, Setting=White-Box, SWAD=true2023.10 | 83.4 | 58.64 | 82.05 | 94.31 | 59.05 | 89.74 | 75.49 | |
| CLIPoodBackbone=ViT-B/16, Initialization=CLIP, Setting=White-Box, SWAD=true2023.10 | 83.31 | 46.28 | 77.19 | 93.16 | 57.78 | 89.9 | 71.55 | |
| ERM FFTBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=true2023.10 | 83.22 | 50.05 | 80.33 | 90.28 | 56.1 | 89.31 | 72 | |
| FLYPBackbone=ViT-B/16, Initialization=CLIP, Setting=White-Box, SWAD=true2023.10 | 82.76 | 33.25 | 66.64 | 78.53 | 57.41 | 78.94 | 63.72 | |
| KDBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=true2023.10 | 82.73 | 48.4 | 80.48 | 91.46 | 56.11 | 89.2 | 71.84 | |
| DARTBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=false2023.10 | 82.56 | 50.7 | 79.7 | 89.76 | 56.13 | 89.99 | 71.77 | |
| Zero-shotBackbone=ViT-B/16, Initialization=CLIP, Setting=White-Box2023.10 | 82.4 | 34.1 | 82.3 | 96.5 | 57.7 | — | 70.6 | |
| SAGMBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=true2023.10 | 82.22 | 53.24 | 79.6 | 90.02 | 55.66 | 89.22 | 72.15 | |
| LP-FTBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=true2023.10 | 81.55 | 51.61 | 80.17 | 91.2 | 56.03 | 90.03 | 72.11 | |
| LP-FTBackbone=ViT-B/16, Initialization=CLIP, Setting=White-Box, SWAD=true2023.10 | 81.17 | 47.26 | 80.88 | 92.92 | 57.04 | 88.97 | 71.85 | |
| SWADBackbone=ViT-B/16, Initialization=CLIP, Setting=White-Box2023.10 | 81.01 | 42.92 | 79.13 | 91.35 | 57.92 | 89.05 | 70.47 | |
| DARTBackbone=ViT-B/16, Initialization=CLIP, Setting=White-Box, SWAD=true2023.10 | 80.93 | 51.24 | 80.38 | 93.43 | 59.32 | 89.25 | 73.06 | |
| SAGMBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=false2023.10 | 80.87 | 52.38 | 79.53 | 87.29 | 54.04 | 88.88 | 73.83 | |
| RISEBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=false2023.10 | 80.34 | 44.64 | 84.15 | 90.99 | 53.29 | 87.42 | 73.47 | |
| MIROBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=true2023.10 | 80.09 | 50.29 | 81.1 | 89.5 | 55.75 | 88.71 | 71.35 | |
| RISEBackbone=ViT-B/16, Initialization=CLIP, Setting=White-Box, SWAD=true2023.10 | 78.39 | 49.61 | 80.62 | 93.25 | 55.37 | 87.91 | 71.45 | |
| ERM FFTBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=false2023.10 | 78.03 | 42.53 | 78.13 | 85.32 | 50.84 | 86.9 | 66.97 | |
| KDBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=false2023.10 | 77.62 | 38.66 | 79.73 | 84.87 | 50.73 | 87.04 | 66.32 | |
| SimKDBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=false2023.10 | 76.89 | 26.32 | 80.16 | 85.66 | 48.45 | 68.31 | 64.3 | |
| LP-FTBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=false2023.10 | 75.23 | 44.05 | 76.51 | 85.08 | 51.1 | 87.59 | 66.4 | |
| MIROBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=false2023.10 | 74.88 | 44.52 | 80.39 | 81.53 | 49.95 | 86.56 | 66.25 | |
| ERM-LPBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=true2023.10 | 71.48 | 31.35 | 77.52 | 67.02 | 36.65 | 73.99 | 56.81 | |
| ERM-LPBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=false2023.10 | 71.45 | 31.8 | 77.77 | 67.52 | 36.66 | 74.25 | 57.04 | |
| Text2ConceptBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=false2023.10 | 70.57 | 26.86 | 79.03 | 66.1 | 23.29 | 53.22 | 53.17 | |
| Text2ConceptBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=true2023.10 | 70.24 | 26.46 | 64.77 | 79.03 | 23.26 | 53.15 | 52.82 | |
| SimKDBackbone=ViT-B/16, Pre-training=ImageNet-1K, SWAD=true2023.10 | 66.76 | 81.01 | 83.92 | 28.24 | 49.42 | 68.24 | 61.87 |