Image Classification on DomainBed v1.0 (test)
78.5Average AccuracyCAR-FT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| CAR-FTBackbone=ViT-B/16, Pre-trained=CLIP2022.11 | 78.5 | 96.8 | 85.5 | 85.7 | 61.9 | 62.5 | — | — | |
| MIRO+SWADBackbone=RegNetY-16GF2022.11 | 77.3 | 96.8 | 81.7 | 83.3 | 64.3 | 60.7 | — | — | |
| EoABackbone=RegNetY-16GF2022.11 | 76.6 | 95.8 | 81.1 | 83.9 | 61.1 | 60.9 | — | — | |
| DPLBackbone=ViT-B/16, Pre-trained=CLIP2022.11 | 75 | 97.3 | 84.3 | 84.2 | 52.6 | 56.7 | — | — | |
| MIROBackbone=RegNetY-16GF2022.11 | 74.1 | 97.4 | 79.9 | 80.4 | 58.9 | 53.8 | — | — | |
| MIROBackbone=ViT-B/16, Pre-trained=CLIP2022.11 | 73.7 | 95.6 | 82.2 | 82.5 | 54.3 | 54 | — | — | |
| ERMBackbone=ViT-B/16, Pre-trained=CLIP2022.11 | 72.2 | 93.7 | 82.7 | 78.5 | 52.3 | 53.8 | — | — | |
| CORALModel selection=training-domain validation set2022.07 | 64.6 | 86.2 | 78.8 | 68.7 | 47.6 | 41.5 | — | — | |
| EQRMModel selection=training-domain validation set2022.07 | 64.1 | 86.5 | 77.8 | 67.5 | 47.8 | 41 | — | — | |
| MLDGModel selection=training-domain validation set2022.07 | 63.6 | 84.9 | 77.2 | 66.8 | 47.7 | 41.2 | — | — | |
| MixupModel selection=training-domain validation set2022.07 | 63.4 | 84.6 | 77.4 | 68.1 | 47.9 | 39.2 | — | — | |
| ERMModel selection=training-domain validation set2022.07 | 63.3 | 85.5 | 77.5 | 66.5 | 46.1 | 40.9 | — | — | |
| VRExModel selection=training-domain validation set2022.07 | 61.9 | 84.9 | 78.3 | 66.4 | 46.4 | 33.6 | — | — | |
| ARMModel selection=training-domain validation set2022.07 | 61.7 | 85.1 | 77.6 | 64.8 | 45.5 | 35.5 | — | — | |
| IRMModel selection=training-domain validation set2022.07 | 61.6 | 83.5 | 78.5 | 64.3 | 47.6 | 33.9 | — | — | |
| GroupDROModel selection=training-domain validation set2022.07 | 60.9 | 84.4 | 76.7 | 66 | 43.2 | 33.3 | — | — | |
| GMDG + L-RegOracle model=RegNetY-16GF2024.10 | 55.3 | — | — | — | — | — | — | — | |
| GMDGOracle model=RegNetY-16GF2024.10 | 54.6 | — | — | — | — | — | — | — | |
| MIROOracle model=RegNetY-16GF2024.10 | 53.8 | — | — | — | — | — | — | — | |
| ERM2024.10 | 44 | — | — | — | — | — | — | — | |
| SelfReg2024.10 | 42.8 | — | — | — | — | — | — | — | |
| mDSDI2024.10 | 42.8 | — | — | — | — | — | — | — | |
| Fish2024.10 | 42.7 | — | — | — | — | — | — | — | |
| CORAL2024.10 | 41.5 | — | — | — | — | — | — | — | |
| MLDG2024.10 | 41.2 | — | — | — | — | — | — | — | |
| MTL2024.10 | 40.6 | — | — | — | — | — | — | — | |
| SagNet2024.10 | 40.3 | — | — | — | — | — | — | — | |
| RSC2024.10 | 38.9 | — | — | — | — | — | — | — | |
| CDANN2024.10 | 38.3 | — | — | — | — | — | — | — | |
| DANN2024.10 | 38.3 | — | — | — | — | — | — | — | |
| ARM2024.10 | 35.5 | — | — | — | — | — | — | — | |
| Mixstyle2024.10 | 34 | — | — | — | — | — | — | — | |
| IRM2024.10 | 33.9 | — | — | — | — | — | — | — | |
| VREX2024.10 | 33.6 | — | — | — | — | — | — | — | |
| GroupDRO2024.10 | 33.3 | — | — | — | — | — | — | — | |
| MMD2024.10 | 23.4 | — | — | — | — | — | — | — |