Image Classification on PACS (Out-of-Domain Evaluation)
96.3Overall AccuracyZooD (F. Selection)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ZooD (F. Selection)Mode=fine-tune ensemble of top-K models with feature selection2022.10 | 96.3 | — | — | — | — | 24.3 | |
| ZooD (Single)Mode=fine-tune top-1 model2022.10 | 96 | — | — | — | — | — | |
| ZooD (Ensemble)Mode=fine-tune ensemble of top-K models2022.10 | 95.5 | — | — | — | — | — | |
| WATT-Pstrategy=Parallel MTWA2024.06 | 94.81 | 96.31 | 96.52 | 99.48 | 86.92 | — | |
| WATT-Sstrategy=Sequential MTWA2024.06 | 94.8 | 96.39 | 96.62 | 99.52 | 86.65 | — | |
| CLIPArTT2024.06 | 93.95 | 96.57 | 96 | 99.28 | 83.93 | — | |
| TENT2024.06 | 93.81 | 96.65 | 96.22 | 99.4 | 82.96 | — | |
| CLIP2024.06 | 93.65 | 96.34 | 96.08 | 99.34 | 82.85 | — | |
| TPT2024.06 | 93.23 | 95.52 | 94.77 | 99.42 | 83.22 | — | |
| SWADProtocol=DomainBed settings2022.10 | 88.1 | — | — | — | — | — | |
| SagNetProtocol=DomainBed settings2022.10 | 86.3 | — | — | — | — | — | |
| MDGHybridBackbone=ResNet-18, Validation Strategy=Test Domain Validation2020.06 | 85.53 | 82.8 | 81.61 | 96.67 | 81.05 | — | |
| ERMProtocol=DomainBed settings2022.10 | 85.5 | — | — | — | — | — | |
| RSCProtocol=DomainBed settings2022.10 | 85.2 | — | — | — | — | — | |
| MixStyleProtocol=DomainBed settings2022.10 | 85.2 | — | — | — | — | — | |
| RSCBackbone=ResNet-18, Validation Strategy=Source Domain Validation2020.06 | 85.15 | 83.43 | 80.31 | 95.99 | 80.85 | — | |
| ARMProtocol=DomainBed settings2022.10 | 85.1 | — | — | — | — | — | |
| MLDGProtocol=DomainBed settings2022.10 | 84.9 | — | — | — | — | — | |
| VRExProtocol=DomainBed settings2022.10 | 84.9 | — | — | — | — | — | |
| MMDProtocol=DomainBed settings2022.10 | 84.7 | — | — | — | — | — | |
| I-MixupProtocol=DomainBed settings2022.10 | 84.6 | — | — | — | — | — | |
| MTLProtocol=DomainBed settings2022.10 | 84.6 | — | — | — | — | — | |
| MatchDGBackbone=ResNet-18, Validation Strategy=Test Domain Validation2020.06 | 84.56 | 81.32 | 80.7 | 96.53 | 79.72 | — | |
| DDECBackbone=ResNet-18, Validation Strategy=Source Domain Validation2020.06 | 84.46 | 83.01 | 79.39 | 96.93 | 78.62 | — | |
| GroupDROProtocol=DomainBed settings2022.10 | 84.4 | — | — | — | — | — | |
| MDGHybridBackbone=ResNet-18, Validation Strategy=Source Domain Validation2020.06 | 84.35 | 81.71 | 80.75 | 96.15 | 78.79 | — | |
| DANNProtocol=DomainBed settings2022.10 | 83.7 | — | — | — | — | — | |
| IRMProtocol=DomainBed settings2022.10 | 83.5 | — | — | — | — | — | |
| DMGBackbone=ResNet-502020.08 | 83.37 | 82.57 | 78.11 | 94.49 | 78.32 | — | |
| G2DMBackbone=ResNet-18, Validation Strategy=Test Domain Validation2020.06 | 83.34 | 81.44 | 79.35 | 94.63 | 79.52 | — | |
| SagNetBackbone=ResNet-18, Validation Strategy=Source Domain Validation2020.06 | 83.25 | 83.58 | 77.66 | 95.47 | 76.3 | — | |
| MatchDGBackbone=ResNet-18, Validation Strategy=Source Domain Validation2020.06 | 83.21 | 79.77 | 80.03 | 95.93 | 77.11 | — | |
| DDAIGBackbone=ResNet-18, Validation Strategy=Source Domain Validation2020.06 | 83.1 | 84.2 | 78.1 | 95.3 | 74.7 | — | |
| RandMatchBackbone=ResNet-18, Validation Strategy=Test Domain Validation2020.06 | 82.91 | 79.09 | 79.37 | 95.57 | 77.6 | — | |
| MASFBackbone=ResNet-502020.08 | 82.67 | 82.89 | 80.49 | 95.01 | 72.29 | — | |
| CDANNProtocol=DomainBed settings2022.10 | 82.6 | — | — | — | — | — | |
| RandMatchBackbone=ResNet-18, Validation Strategy=Source Domain Validation2020.06 | 81.87 | 78.16 | 78.83 | 95.37 | 75.13 | — | |
| ERMBackbone=ResNet-18, Validation Strategy=Source Domain Validation2020.06 | 81.7 | 77.68 | 78.98 | 95.38 | 74.75 | — | |
| Epi-FCRBackbone=ResNet-182020.08 | 81.5 | 82.1 | 77 | 93.9 | 73 | — | |
| DMGBackbone=ResNet-182020.08 | 81.46 | 76.9 | 80.38 | 93.35 | 75.21 | — | |
| CSDBackbone=ResNet-18, Validation Strategy=Source Domain Validation2020.06 | 81.4 | 78.9 | 75.8 | 94.1 | 76.7 | — | |
| G2DMBackbone=ResNet-18, Validation Strategy=Source Domain Validation2020.06 | 81.16 | 77.78 | 75.54 | 93.75 | 77.58 | — | |
| MASFBackbone=ResNet-182020.08 | 81.03 | 80.29 | 77.17 | 94.99 | 71.68 | — | |
| MLDGBackbone=ResNet-182020.08 | 80.7 | 79.5 | 77.3 | 94.3 | 71.5 | — | |
| Multi-HeadedBackbone=ResNet-502020.08 | 80.51 | 75.15 | 76.37 | 95.27 | 75.26 | — | |
| JiGenBackbone=ResNet-18, Validation Strategy=Source Domain Validation2020.06 | 80.41 | 79.42 | 75.25 | 96 | 71.35 | — | |
| MetaRegBackbone=ResNet-182020.08 | 80.4 | 79.5 | 75.4 | 94.3 | 72.2 | — | |
| Multi-HeadedBackbone=ResNet-182020.08 | 79.24 | 78.76 | 72.1 | 94.31 | 71.77 | — | |
| AggregateBackbone=ResNet-182020.08 | 79.1 | 77.6 | 73.9 | 94.4 | 74.3 | — | |
| Aggregate*Backbone=ResNet-502020.08 | 78.38 | 75.49 | 80.67 | 93.05 | 64.29 | — | |
| CrossGradBackbone=ResNet-182020.08 | 77.8 | 78.7 | 73.3 | 94 | 65.1 | — | |
| Aggregate*Backbone=ResNet-182020.08 | 77.36 | 72.61 | 78.46 | 93.17 | 65.2 | — | |
| MASFBackbone=AlexNet2020.08 | 75.21 | 70.35 | 72.46 | 90.68 | 67.33 | — | |
| DMGBackbone=AlexNet2020.08 | 73.32 | 64.65 | 69.88 | 87.31 | 71.42 | — | |
| Epi-FCRBackbone=AlexNet2020.08 | 72 | 64.7 | 72.3 | 86.1 | 65 | — | |
| FusionBackbone=AlexNet2020.08 | 70.3 | 64.1 | 66.8 | 90.2 | 60.1 | — | |
| MLDGBackbone=AlexNet2020.08 | 70 | 66.2 | 66.9 | 88 | 59 | — | |
| MetaRegBackbone=AlexNet2020.08 | 69.9 | 63.5 | 69.5 | 87.4 | 59.1 | — | |
| AggregateBackbone=AlexNet2020.08 | 68.7 | 63.4 | 66.1 | 88.5 | 56.6 | — | |
| Aggregate*Backbone=AlexNet2020.08 | 68.38 | 56.2 | 70.69 | 86.29 | 60.32 | — | |
| Multi-HeadedBackbone=AlexNet2020.08 | 67.97 | 61.67 | 67.88 | 82.93 | 59.38 | — | |
| CrossGradBackbone=AlexNet2020.08 | 67.9 | 61 | 67.2 | 87.6 | 55.9 | — | |
| DSNBackbone=AlexNet2020.08 | 67.4 | 61.1 | 66.5 | 83.3 | 58.6 | — |