Domain Generalization on PACS DomainBed (test)
97.2AccuracyApprox. Optimal Z*
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Approx. Optimal Z*Selection=Oracle selection2021.12 | 97.2 | — | — | — | — | — | |
| CLIP L + CADModel Selection=oracle selection, Backbone=CLIP-ViT-L/142021.12 | 94.9 | — | — | — | — | — | |
| CLIP L + CADBackbone=ViT-B/32, Pretraining=CLIP, Bottleneck=CAD2021.12 | 94.9 | — | — | — | — | — | |
| CLIP LModel Selection=oracle selection, Backbone=CLIP-ViT-L/142021.12 | 93.7 | — | — | — | — | — | |
| CLIP LBackbone=ViT-B/32, Pretraining=CLIP2021.12 | 93.7 | — | — | — | — | — | |
| CLIP S + CADModel Selection=oracle selection, Backbone=CLIP-ResNet502021.12 | 92 | — | — | — | — | — | |
| CLIP S + CADBackbone=ResNet-50, Pretraining=CLIP, Bottleneck=CAD2021.12 | 92 | — | — | — | — | — | |
| CLIP SModel Selection=oracle selection, Backbone=CLIP-ResNet50, zero-shot=true2021.12 | 91.8 | — | — | — | — | — | |
| CLIP S + BaseModel Selection=oracle selection, Backbone=CLIP-ResNet502021.12 | 91.2 | — | — | — | — | — | |
| CLIP S + BaseBackbone=ResNet-50, Pretraining=CLIP, Mode=Finetuned2021.12 | 91.2 | — | — | — | — | — | |
| CLIP SModel Selection=oracle selection, Backbone=CLIP-ResNet502021.12 | 90.3 | — | — | — | — | — | |
| CLIP SBackbone=ResNet-50, Pretraining=CLIP2021.12 | 90.3 | — | — | — | — | — | |
| CADModel Selection=oracle selection, Backbone=ResNet-502021.12 | 87.3 | — | — | — | — | — | |
| MMDModel Selection=oracle selection, Backbone=ResNet-502021.12 | 87.2 | — | — | — | — | — | |
| VRExModel Selection=oracle selection, Backbone=ResNet-502021.12 | 87.2 | — | — | — | — | — | |
| DomainBed SOTA2021.12 | 87.2 | — | — | — | — | — | |
| GroupDROModel Selection=oracle selection, Backbone=ResNet-502021.12 | 87.1 | — | — | — | — | — | |
| CORALModel Selection=oracle selection, Backbone=ResNet-502021.12 | 87.1 | — | — | — | — | — | |
| MixupModel Selection=oracle selection, Backbone=ResNet-502021.12 | 86.8 | — | — | — | — | — | |
| ERMModel Selection=oracle selection, Backbone=ResNet-502021.12 | 86.7 | — | — | — | — | — | |
| ERM2021.12 | 86.7 | — | — | — | — | — | |
| CDANNModel Selection=oracle selection, Backbone=ResNet-502021.12 | 85.8 | — | — | — | — | — | |
| V-RExmodel selection=training-domain validation set2020.03 | 85.8 | — | — | — | — | — | |
| ERMmodel selection=training-domain validation set2020.03 | 85.7 | — | — | — | — | — | |
| DANNModel Selection=oracle selection, Backbone=ResNet-502021.12 | 85.2 | — | — | — | — | — | |
| IRMModel Selection=oracle selection, Backbone=ResNet-502021.12 | 84.5 | — | — | — | — | — | |
| IRMmodel selection=training-domain validation set2020.03 | 84.4 | — | — | — | — | — | |
| DINO + CADModel Selection=oracle selection, Backbone=DINO2021.12 | 76.1 | — | — | — | — | — | |
| DINO + CADPretraining=DINO, Bottleneck=CAD2021.12 | 76.1 | — | — | — | — | — | |
| ARMTT (minutes)=242024.10 | — | 79.4 | 75 | 94.3 | 73.8 | 80.6 | |
| CADTT (minutes)=242024.10 | — | 83.9 | 74.2 | 94.6 | 75 | 81.9 | |
| CDANNTT (minutes)=242024.10 | — | 80.4 | 73.7 | 93.1 | 74.2 | 80.3 | |
| CondCADTT (minutes)=262024.10 | — | 79.7 | 74.2 | 94.6 | 74.8 | 80.8 | |
| CORALTT (minutes)=242024.10 | — | 81.5 | 75.4 | 95.2 | 74.8 | 81.7 | |
| DANNTT (minutes)=172024.10 | — | 79 | 72.5 | 94.4 | 70.8 | 79.2 | |
| ERMTT (minutes)=242024.10 | — | 78 | 73.4 | 94.1 | 73.6 | 79.8 | |
| ERM+TT (minutes)=242024.10 | — | 81.9 | 75.1 | 94.8 | 73.8 | 81.4 | |
| FishTT (minutes)=522024.10 | — | 80.9 | 75.9 | 95 | 76.2 | 82 | |
| FishrTT (minutes)=172024.10 | — | 81.2 | 75.8 | 94.3 | 73.8 | 81.3 | |
| GroupGROTT (minutes)=242024.10 | — | 77.7 | 76.4 | 94 | 74.8 | 80.7 | |
| IRMTT (minutes)=182024.10 | — | 76.9 | 75.1 | 94.3 | 77.4 | 80.9 | |
| ITTATT (minutes)=622024.10 | — | 84.7 | 78 | 94.5 | 78.2 | 83.8 | |
| LFMETT (minutes)=382024.10 | — | 81 | 76.5 | 94.6 | 77.4 | 82.4 | |
| Meta-DMoETT (minutes)=452024.10 | — | 78.7 | 74.2 | 94.4 | 76.7 | 81 | |
| MIROTT (minutes)=312024.10 | — | 79.3 | 68.1 | 95.5 | 60.6 | 75.9 | |
| MixStyleTT (minutes)=252024.10 | — | 82.6 | 76.3 | 94.2 | 77.5 | 82.6 | |
| MixupTT (minutes)=182024.10 | — | 79.3 | 74.2 | 94.9 | 68.3 | 79.2 | |
| MLDGTT (minutes)=322024.10 | — | 78.4 | 75.1 | 94.8 | 76.7 | 81.3 | |
| MMDTT (minutes)=182024.10 | — | 81.3 | 75.5 | 94 | 74.3 | 81.3 | |
| MTLTT (minutes)=182024.10 | — | 78.7 | 73.4 | 94.1 | 74.4 | 80.1 | |
| RSCTT (minutes)=252024.10 | — | 78.5 | 73.3 | 93.6 | 76.5 | 80.5 | |
| SagNetTT (minutes)=242024.10 | — | 82.9 | 73.2 | 94.6 | 76.1 | 81.7 | |
| SDTT (minutes)=252024.10 | — | 83.2 | 74.6 | 94.6 | 75.1 | 81.9 | |
| SelfRegTT (minutes)=252024.10 | — | 82.5 | 74.4 | 95.4 | 74.9 | 81.8 | |
| VRExTT (minutes)=172024.10 | — | 74.4 | 75 | 93.3 | 78.1 | 80.2 |