Domain Generalization on Colored MNIST DomainBed (leave-one-environment-out)
82Performance Score (+90%)ARM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ARMFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 82 | 76.5 | 10.2 | 56.2 | |
| GroupDROFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 73.1 | 73.2 | 10 | 52.1 | |
| MixupFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 72.7 | 73.4 | 10.1 | 52.1 | |
| IRMFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 72.5 | 73.3 | 10.2 | 52 | |
| VRExFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 72.4 | 72.9 | 10.2 | 51.8 | |
| CROFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed, seeds=32026.05 | 72.1 | 72.4 | 76 | 73.5 | |
| CDANNFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 72 | 73 | 10.2 | 51.7 | |
| RSCFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 71.9 | 73.1 | 10 | 51.7 | |
| SagNetFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 71.8 | 73 | 10.3 | 51.7 | |
| ERMFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 71.7 | 72.9 | 10 | 51.5 | |
| CORALFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 71.6 | 73.1 | 9.9 | 51.5 | |
| MLDGFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 71.5 | 73.1 | 9.8 | 51.5 | |
| MMDFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 71.4 | 73.1 | 9.9 | 51.5 | |
| DANNFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 71.4 | 73.1 | 10 | 51.5 | |
| MTLFeaturizer=DomainBed’s MNIST_CNN, Validation Rule=training-domain validation, Hyperparameter Budget=20-configuration x 3-seed2026.05 | 70.9 | 72.8 | 10.5 | 51.4 |