Domain Generalization on VLCS DomainBed (test)
78.4Average OOD AccuracySparse and Shared Feature Activations
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Sparse and Shared Feature ActivationsFramework=DomainBed2023.04 | 78.4 | — | 98.1 | 63.4 | 78.2 | 73.9 | — | — | — | — | |
| ERMFramework=DomainBed2023.04 | 77.4 | — | 97.6 | 63.3 | 76.4 | 72.2 | — | — | — | — | |
| FishHyper-parameters=DomainBed default settings2024.10 | 76.9 | — | — | — | — | — | 97.4 | 63.4 | 71.5 | 75.2 | |
| ITTAHyper-parameters=DomainBed default settings2024.10 | 76.9 | — | — | — | — | — | 96.9 | 63.7 | 72 | 74.9 | |
| SelfRegHyper-parameters=DomainBed default settings2024.10 | 76.4 | — | — | — | — | — | 95.8 | 63.4 | 71.1 | 75.3 | |
| DANNHyper-parameters=DomainBed default settings2024.10 | 76.3 | — | — | — | — | — | 97.2 | 63.3 | 70.2 | 74.4 | |
| MixupHyper-parameters=DomainBed default settings2024.10 | 76.2 | — | — | — | — | — | 95.6 | 62.7 | 71.3 | 75.4 | |
| FishrHyper-parameters=DomainBed default settings2024.10 | 76.2 | — | — | — | — | — | 97.2 | 63.3 | 70.4 | 74 | |
| LFMEHyper-parameters=DomainBed default settings2024.10 | 76.2 | — | — | — | — | — | 96.4 | 62.8 | 70.1 | 75.4 | |
| CondCADHyper-parameters=DomainBed default settings2024.10 | 76.1 | — | — | — | — | — | 96.5 | 62.6 | 69.1 | 76 | |
| ERM+Hyper-parameters=DomainBed default settings2024.10 | 76.1 | — | — | — | — | — | 96 | 61.9 | 71.5 | 75 | |
| CDANNHyper-parameters=DomainBed default settings2024.10 | 76 | — | — | — | — | — | 95.4 | 62.6 | 69.9 | 76.2 | |
| Meta-DMoEHyper-parameters=DomainBed default settings2024.10 | 76 | — | — | — | — | — | 96.4 | 62.5 | 70.3 | 74.9 | |
| ARMHyper-parameters=DomainBed default settings2024.10 | 75.9 | — | — | — | — | — | 96.9 | 61.9 | 71.6 | 73.3 | |
| ERMHyper-parameters=DomainBed default settings2024.10 | 75.8 | — | — | — | — | — | 97.7 | 62.1 | 70.3 | 73.2 | |
| CORALHyper-parameters=DomainBed default settings2024.10 | 75.5 | — | — | — | — | — | 96.5 | 62.8 | 69.1 | 73.8 | |
| SDHyper-parameters=DomainBed default settings2024.10 | 75.5 | — | — | — | — | — | 96.5 | 62.2 | 69.7 | 73.6 | |
| GroupGROHyper-parameters=DomainBed default settings2024.10 | 75.4 | — | — | — | — | — | 96.7 | 61.7 | 70.2 | 72.9 | |
| SagNetHyper-parameters=DomainBed default settings2024.10 | 75.4 | — | — | — | — | — | 94.9 | 61.9 | 69.6 | 75.2 | |
| RSCHyper-parameters=DomainBed default settings2024.10 | 75.4 | — | — | — | — | — | 96.2 | 63.6 | 69.8 | 72 | |
| VRExHyper-parameters=DomainBed default settings2024.10 | 75.3 | — | — | — | — | — | 96.2 | 62.5 | 69.3 | 73.1 | |
| MLDGHyper-parameters=DomainBed default settings2024.10 | 75.2 | — | — | — | — | — | 95.8 | 63.3 | 68.5 | 73.1 | |
| MTLHyper-parameters=DomainBed default settings2024.10 | 75.2 | — | — | — | — | — | 94.4 | 65 | 69.6 | 71.7 | |
| MixStyleHyper-parameters=DomainBed default settings2024.10 | 75.2 | — | — | — | — | — | 97.3 | 61.6 | 70.4 | 71.3 | |
| CADHyper-parameters=DomainBed default settings2024.10 | 75.2 | — | — | — | — | — | 94.5 | 63.5 | 70.4 | 72.4 | |
| IRMHyper-parameters=DomainBed default settings2024.10 | 75.1 | — | — | — | — | — | 96.1 | 62.5 | 69.9 | 72 | |
| MMDHyper-parameters=DomainBed default settings2024.10 | 74.9 | — | — | — | — | — | 96 | 64.3 | 68.5 | 70.8 | |
| Approx. Optimal Z*Selection=Oracle selection2021.12 | — | 86.8 | — | — | — | — | — | — | — | — | |
| CLIP LBackbone=ViT-B/32, Pretraining=CLIP2021.12 | — | 80.7 | — | — | — | — | — | — | — | — | |
| CLIP L + CADBackbone=ViT-B/32, Pretraining=CLIP, Bottleneck=CAD2021.12 | — | 81.6 | — | — | — | — | — | — | — | — | |
| CLIP SBackbone=ResNet-50, Pretraining=CLIP2021.12 | — | 81.1 | — | — | — | — | — | — | — | — | |
| CLIP S + BaseBackbone=ResNet-50, Pretraining=CLIP, Mode=Finetuned2021.12 | — | 81.3 | — | — | — | — | — | — | — | — | |
| CLIP S + CADBackbone=ResNet-50, Pretraining=CLIP, Bottleneck=CAD2021.12 | — | 82.3 | — | — | — | — | — | — | — | — | |
| DINO + CADPretraining=DINO, Bottleneck=CAD2021.12 | — | 69.6 | — | — | — | — | — | — | — | — | |
| DomainBed SOTA2021.12 | — | 79.9 | — | — | — | — | — | — | — | — | |
| ERM2021.12 | — | 77.6 | — | — | — | — | — | — | — | — | |
| ERMmodel selection=training-domain validation set2020.03 | — | 77.4 | — | — | — | — | — | — | — | — | |
| IRMmodel selection=training-domain validation set2020.03 | — | 78.1 | — | — | — | — | — | — | — | — | |
| V-RExmodel selection=training-domain validation set2020.03 | — | 77.9 | — | — | — | — | — | — | — | — |