Image Classification on Colored-MNIST (CMNIST)
94.43AccuracyGIW
Evaluation Results
| Method | Links | |
|---|---|---|
| GIWShift=CS 10, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 94.43 | |
| GIWShift=LN 0.2, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 90.99 | |
| GIWShift=LN 0.4, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 90.09 | |
| GIWShift=CS 100, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 88.34 | |
| Pretrain-valShift=CS 10, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 87.63 | |
| CCSAShift=LN 0.2, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 84.32 | |
| CCSAShift=LN 0.4, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 80.32 | |
| Pretrain-valShift=CS 100, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 79.7 | |
| DANNShift=LN 0.4, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 70.27 | |
| CCSAShift=CS 10, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 67.39 | |
| CCSAShift=CS 100, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 64.15 | |
| DANNShift=LN 0.2, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 60.65 | |
| Pretrain-valShift=LN 0.2, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 60.21 | |
| Pretrain-valShift=LN 0.4, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 57.13 | |
| ARMBackbone=MNIST-ConvNet2021.10 | 56.2 | |
| mDSDIBackbone=MNIST-ConvNet2021.10 | 52.2 | |
| GroupDROBackbone=MNIST-ConvNet2021.10 | 52.1 | |
| MixupBackbone=MNIST-ConvNet2021.10 | 52.1 | |
| IRMBackbone=MNIST-ConvNet2021.10 | 52 | |
| VREXBackbone=MNIST-ConvNet2021.10 | 51.8 | |
| CDANNBackbone=MNIST-ConvNet2021.10 | 51.7 | |
| SagNetsBackbone=MNIST-ConvNet2021.10 | 51.7 | |
| RSCBackbone=MNIST-ConvNet2021.10 | 51.7 | |
| ERMBackbone=MNIST-ConvNet2021.10 | 51.5 | |
| MLDGBackbone=MNIST-ConvNet2021.10 | 51.5 | |
| CORALBackbone=MNIST-ConvNet2021.10 | 51.5 | |
| MMDBackbone=MNIST-ConvNet2021.10 | 51.5 | |
| DANNBackbone=MNIST-ConvNet2021.10 | 51.5 | |
| MTLBackbone=MNIST-ConvNet2021.10 | 51.4 | |
| Causal Transportabilityconfig=Ours2022.04 | 51.4 | |
| DANNShift=CS 10, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 49.65 | |
| Causal Transportabilityconfig=Ablation2022.04 | 38.8 | |
| DANNShift=CS 100, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 36.16 | |
| Val-onlyShift=CS 10, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 31.22 | |
| Val-onlyShift=CS 100, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 31.22 | |
| Val-onlyShift=LN 0.2, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 31.19 | |
| Val-onlyShift=LN 0.4, Shift Case=(iii), Evaluation Protocol=DA baselines2023.05 | 31.19 | |
| GenInt2022.04 | 29.6 | |
| RSC2022.04 | 20.6 | |
| IRM*2022.04 | 18.5 | |
| Chance2022.04 | 10 | |
| ERM2022.04 | 8.3 |