Domain Generalization on TerraIncognita DomainBed (test)
76.5AccuracyApprox. Optimal Z*
Evaluation Results
| Method | Links | |
|---|---|---|
| Approx. Optimal Z*Selection=Oracle selection2021.12 | 76.5 | |
| MixupModel Selection=oracle selection, Backbone=ResNet-502021.12 | 54.4 | |
| DomainBed SOTA2021.12 | 54.4 | |
| CADModel Selection=oracle selection, Backbone=ResNet-502021.12 | 53.5 | |
| ERMModel Selection=oracle selection, Backbone=ResNet-502021.12 | 53 | |
| ERM2021.12 | 53 | |
| CORALModel Selection=oracle selection, Backbone=ResNet-502021.12 | 52.8 | |
| GroupDROModel Selection=oracle selection, Backbone=ResNet-502021.12 | 52.4 | |
| MMDModel Selection=oracle selection, Backbone=ResNet-502021.12 | 52 | |
| VRExModel Selection=oracle selection, Backbone=ResNet-502021.12 | 51.4 | |
| CDANNModel Selection=oracle selection, Backbone=ResNet-502021.12 | 50.8 | |
| DANNModel Selection=oracle selection, Backbone=ResNet-502021.12 | 50.6 | |
| IRMModel Selection=oracle selection, Backbone=ResNet-502021.12 | 50.5 | |
| CLIP L + CADModel Selection=oracle selection, Backbone=CLIP-ViT-L/142021.12 | 40.6 | |
| CLIP L + CADBackbone=ViT-B/32, Pretraining=CLIP, Bottleneck=CAD2021.12 | 40.6 | |
| CLIP LModel Selection=oracle selection, Backbone=CLIP-ViT-L/142021.12 | 36.9 | |
| CLIP LBackbone=ViT-B/32, Pretraining=CLIP2021.12 | 36.9 | |
| CLIP S + BaseModel Selection=oracle selection, Backbone=CLIP-ResNet502021.12 | 36.4 | |
| CLIP S + BaseBackbone=ResNet-50, Pretraining=CLIP, Mode=Finetuned2021.12 | 36.4 | |
| CLIP S + CADModel Selection=oracle selection, Backbone=CLIP-ResNet502021.12 | 36.2 | |
| CLIP S + CADBackbone=ResNet-50, Pretraining=CLIP, Bottleneck=CAD2021.12 | 36.2 | |
| CLIP SModel Selection=oracle selection, Backbone=CLIP-ResNet502021.12 | 29.6 | |
| CLIP SBackbone=ResNet-50, Pretraining=CLIP2021.12 | 29.6 | |
| DINO + CADModel Selection=oracle selection, Backbone=DINO2021.12 | 25.9 | |
| DINO + CADPretraining=DINO, Bottleneck=CAD2021.12 | 25.9 | |
| CLIP SModel Selection=oracle selection, Backbone=CLIP-ResNet50, zero-shot=true2021.12 | 19.1 |