Image Classification on PACS v1 (test)
87.83Average AccuracyRSC
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| RSCBackbone=ResNet-50, Validation Strategy=Default2020.06 | 87.83 | 87.89 | 82.16 | 97.92 | 83.35 | |
| MDGHybridBackbone=ResNet-50, Validation Strategy=Default2020.06 | 87.52 | 86.74 | 82.32 | 98.36 | 82.66 | |
| MatchDGBackbone=ResNet-50, Validation Strategy=Default2020.06 | 86.11 | 85.61 | 82.12 | 97.94 | 78.76 | |
| CORALBackbone=ResNet-50, Validation Strategy=Default2020.06 | 86 | 87.7 | 79.2 | 97.6 | 79.4 | |
| DomainBedBackbone=ResNet-50, Validation Strategy=Default2020.06 | 85.7 | 88.1 | 77.9 | 97.8 | 79.1 | |
| RandMatchBackbone=ResNet-50, Validation Strategy=Default2020.06 | 85.54 | 82.16 | 81.68 | 97.89 | 80.45 | |
| MDGHybridBackbone=ResNet-18, Validation Strategy=Test Domain Validation2020.06 | 85.53 | 82.8 | 81.61 | 96.67 | 81.05 | |
| DGERBackbone=ResNet-50, Validation Strategy=Default2020.06 | 85.34 | 87.51 | 79.31 | 98.25 | 76.3 | |
| RSCBackbone=ResNet-18, Validation Strategy=Default2020.06 | 85.15 | 83.43 | 80.31 | 95.99 | 80.85 | |
| MMDBackbone=ResNet-50, Validation Strategy=Default2020.06 | 85 | 84.5 | 79.7 | 97.5 | 78.1 | |
| MLDGBackbone=ResNet-50, Validation Strategy=Default2020.06 | 84.8 | 89.1 | 78.8 | 97 | 74.4 | |
| DANNBackbone=ResNet-50, Validation Strategy=Default2020.06 | 84.6 | 85.9 | 79.9 | 97.6 | 75.2 | |
| MatchDGBackbone=ResNet-18, Validation Strategy=Test Domain Validation2020.06 | 84.56 | 81.32 | 80.7 | 96.53 | 79.72 | |
| DDECBackbone=ResNet-18, Validation Strategy=Default2020.06 | 84.46 | 83.01 | 79.39 | 96.93 | 78.62 | |
| IRMBackbone=ResNet-50, Validation Strategy=Default2020.06 | 84.4 | 85 | 77.6 | 96.7 | 78.5 | |
| MDGHybridBackbone=ResNet-18, Validation Strategy=Default2020.06 | 84.35 | 81.71 | 80.75 | 96.15 | 78.79 | |
| MixupBackbone=ResNet-50, Validation Strategy=Default2020.06 | 84.3 | 86.5 | 76.6 | 97.7 | 76.5 | |
| DROBackbone=ResNet-50, Validation Strategy=Default2020.06 | 84.1 | 86.4 | 79.9 | 98 | 72.1 | |
| MetaRegBackbone=ResNet-50, Validation Strategy=Default2020.06 | 83.6 | 87.2 | 79.2 | 97.6 | 70.3 | |
| DMGBackbone=ResNet-502020.08 | 83.37 | 82.57 | 78.11 | 94.49 | 78.32 | |
| G2DMBackbone=ResNet-18, Validation Strategy=Test Domain Validation2020.06 | 83.34 | 81.44 | 79.35 | 94.63 | 79.52 | |
| SagNetBackbone=ResNet-18, Validation Strategy=Default2020.06 | 83.25 | 83.58 | 77.66 | 95.47 | 76.3 | |
| MatchDGBackbone=ResNet-18, Validation Strategy=Default2020.06 | 83.21 | 79.77 | 80.03 | 95.93 | 77.11 | |
| DDAIGBackbone=ResNet-18, Validation Strategy=Default2020.06 | 83.1 | 84.2 | 78.1 | 95.3 | 74.7 | |
| RandMatchBackbone=ResNet-18, Validation Strategy=Test Domain Validation2020.06 | 82.91 | 79.09 | 79.37 | 95.57 | 77.6 | |
| C-DANNBackbone=ResNet-50, Validation Strategy=Default2020.06 | 82.8 | 84 | 78.5 | 97 | 71.8 | |
| MASFBackbone=ResNet-502020.08 | 82.67 | 82.89 | 80.49 | 95.01 | 72.29 | |
| MASFBackbone=ResNet-50, Validation Strategy=Default2020.06 | 82.67 | 82.89 | 80.49 | 95.01 | 72.29 | |
| RandMatchBackbone=ResNet-18, Validation Strategy=Default2020.06 | 81.87 | 78.16 | 78.83 | 95.37 | 75.13 | |
| MMLDBackbone=ResNet-18, Validation Strategy=Default2020.06 | 81.83 | 81.28 | 77.16 | 96.09 | 72.29 | |
| ERMBackbone=ResNet-18, Validation Strategy=Default2020.06 | 81.7 | 77.68 | 78.98 | 95.38 | 74.75 | |
| MetaRegBackbone=ResNet-18, Validation Strategy=Default2020.06 | 81.7 | 83.7 | 77.2 | 95.5 | 70.3 | |
| D-SAMBackbone=ResNet-18, Validation Strategy=Default2020.06 | 81.55 | 79.48 | 77.13 | 94.3 | 75.3 | |
| Epi-FCRBackbone=ResNet-182019.01 | 81.5 | 82.1 | 77 | 93.9 | 73 | |
| Epi-FCRBackbone=ResNet-182020.08 | 81.5 | 82.1 | 77 | 93.9 | 73 | |
| EpiFCRBackbone=ResNet-18, Validation Strategy=Default2020.06 | 81.5 | 82.1 | 77 | 93.9 | 73 | |
| S-MLDGBackbone=ResNet-18, Validation Strategy=Default2020.06 | 81.5 | 80.5 | 77.8 | 94.8 | 72.8 | |
| StyleMatch + UPCSCBackbone=ResNet18, Labels per class=102025.03 | 81.5 | — | — | — | — | |
| DMGBackbone=ResNet-182020.08 | 81.46 | 76.9 | 80.38 | 93.35 | 75.21 | |
| CSDBackbone=ResNet-18, Validation Strategy=Default2020.06 | 81.4 | 78.9 | 75.8 | 94.1 | 76.7 | |
| DGERBackbone=ResNet-18, Validation Strategy=Default2020.06 | 81.38 | 80.7 | 76.4 | 96.65 | 71.77 | |
| G2DMBackbone=ResNet-18, Validation Strategy=Default2020.06 | 81.16 | 77.78 | 75.54 | 93.75 | 77.58 | |
| MASFBackbone=ResNet-18, Validation Strategy=Default2020.06 | 81.04 | 80.29 | 77.17 | 94.99 | 71.69 | |
| MASFBackbone=ResNet-182020.08 | 81.03 | 80.29 | 77.17 | 94.99 | 71.68 | |
| DANNBackbone=ResNet-182019.01 | 80.8 | 81.3 | 73.8 | 94 | 74.3 | |
| DANNBackbone=ResNet-182020.08 | 80.8 | 81.3 | 73.8 | 94 | 74.3 | |
| MLDGBackbone=ResNet-182019.01 | 80.7 | 79.5 | 77.3 | 94.3 | 71.5 | |
| MLDGBackbone=ResNet-182020.08 | 80.7 | 79.5 | 77.3 | 94.3 | 71.5 | |
| MAMLBackbone=ResNet-182019.01 | 80.6 | 78.3 | 76.5 | 95.1 | 72.6 | |
| MAMLBackbone=ResNet-182020.08 | 80.6 | 78.3 | 76.5 | 95.1 | 72.6 | |
| Multi-HeadedBackbone=ResNet-502020.08 | 80.51 | 75.15 | 76.37 | 95.27 | 75.26 | |
| JiGenBackbone=ResNet-18, Validation Strategy=Default2020.06 | 80.41 | 79.42 | 75.25 | 96 | 71.35 | |
| MetaRegBackbone=ResNet-182019.01 | 80.4 | 79.5 | 75.4 | 94.3 | 72.2 | |
| MetaRegBackbone=ResNet-182020.08 | 80.4 | 79.5 | 75.4 | 94.3 | 72.2 | |
| StyleMatchBackbone=ResNet18, Labels per class=102025.03 | 79.9 | — | — | — | — | |
| FixMatch + UPCSCBackbone=ResNet18, Labels per class=102025.03 | 79.6 | — | — | — | — | |
| Multi-HeadedBackbone=ResNet-182020.08 | 79.24 | 78.76 | 72.1 | 94.31 | 71.77 | |
| AGGBackbone=ResNet-182019.01 | 79.1 | 77.6 | 73.9 | 94.4 | 70.3 | |
| AggregateBackbone=ResNet-18, Source=Reported in [29]2020.08 | 79.1 | 77.6 | 73.9 | 94.4 | 70.3 | |
| AggregateBackbone=ResNet-50, Source=Own implementation2020.08 | 78.38 | 75.49 | 80.67 | 93.05 | 64.29 | |
| CrossGradBackbone=ResNet-182019.01 | 77.8 | 78.7 | 73.3 | 94 | 65.1 | |
| CrossGradBackbone=ResNet-182020.08 | 77.8 | 78.7 | 73.3 | 94 | 65.1 | |
| FreeMatch + UPCSCBackbone=ResNet18, Labels per class=102025.03 | 77.8 | — | — | — | — | |
| AggregateBackbone=ResNet-18, Source=Own implementation2020.08 | 77.36 | 72.61 | 78.46 | 93.17 | 65.2 | |
| FixMatchBackbone=ResNet18, Labels per class=102025.03 | 76.8 | — | — | — | — | |
| MASFBackbone=AlexNet2020.08 | 75.21 | 70.35 | 72.46 | 90.68 | 67.33 | |
| FreeMatchBackbone=ResNet18, Labels per class=102025.03 | 73.5 | — | — | — | — | |
| DMGBackbone=AlexNet2020.08 | 73.32 | 64.65 | 69.88 | 87.31 | 71.42 | |
| Epi-FCRBackbone=AlexNet2020.08 | 72 | 64.7 | 72.3 | 86.1 | 65 | |
| FusionBackbone=AlexNet2020.08 | 70.3 | 64.1 | 66.8 | 90.2 | 60.1 | |
| MLDGBackbone=AlexNet2020.08 | 70 | 66.2 | 66.9 | 88 | 59 | |
| MetaRegBackbone=AlexNet2020.08 | 69.9 | 63.5 | 69.5 | 87.4 | 59.1 | |
| Multi-component Image Translation (JANs)synthetic_data=ComboGAN, architecture=JAN2018.12 | 69.45 | 62.64 | 65.98 | 90.44 | 58.76 | |
| DBADG2018.12 | 69.21 | 62.86 | 66.97 | 89.5 | 57.51 | |
| TF-CNNBackbone=AlexNet2020.08 | 69.2 | 62.9 | 67 | 89.5 | 57.5 | |
| Multi-component Image Translation (RTNs)synthetic_data=ComboGAN, architecture=RTN2018.12 | 69.18 | 62.64 | 66.52 | 89.86 | 57.68 | |
| Multi-component Image Translation (DANs)synthetic_data=ComboGAN, architecture=DAN2018.12 | 69.12 | 64.69 | 63.6 | 90.11 | 58.08 | |
| DANNBackbone=AlexNet2020.08 | 69 | 63.2 | 67.5 | 88.1 | 57 | |
| Multi-component Image Translation (D-CORALs)synthetic_data=ComboGAN, architecture=D-CORAL2018.12 | 68.9 | 61.37 | 66.16 | 89.16 | 58.92 | |
| AggregateBackbone=AlexNet, Source=Reported in [29]2020.08 | 68.7 | 63.4 | 66.1 | 88.5 | 56.6 | |
| AggregateBackbone=AlexNet, Source=Own implementation2020.08 | 68.38 | 56.2 | 70.69 | 86.29 | 60.32 | |
| UDICA2018.12 | 68 | 64.57 | 64.54 | 91.78 | 51.12 | |
| DICABackbone=AlexNet2020.08 | 68 | 64.6 | 64.5 | 91.8 | 51.1 | |
| Multi-HeadedBackbone=AlexNet2020.08 | 67.97 | 61.67 | 67.88 | 82.93 | 59.38 | |
| CrossGradBackbone=AlexNet2020.08 | 67.9 | 61 | 67.2 | 87.6 | 55.9 | |
| DSNBackbone=AlexNet2020.08 | 67.4 | 61.1 | 66.5 | 83.3 | 58.6 | |
| MeanTeacherBackbone=ResNet18, Labels per class=102025.03 | 66 | — | — | — | — | |
| D-MTAEBackbone=AlexNet2020.08 | 64.5 | 60.3 | 58.7 | 91.1 | 47.9 | |
| MTAE2018.12 | 64.48 | 60.27 | 58.65 | 91.12 | 47.86 | |
| DSN2018.12 | 63.38 | 61.13 | 66.54 | 83.25 | 58.58 | |
| ERMBackbone=ResNet18, Labels per class=102025.03 | 60.2 | — | — | — | — | |
| LRE-SVM2018.12 | 58.99 | 59.74 | 52.81 | 85.53 | 37.89 |