Image Classification on Colored MNIST (test)
75AccuracyOPTIMAL
Evaluation results
| Method | Links | |
|---|---|---|
| OPTIMAL2020.02 | 75 | |
| Optimal invariant modeltype=hypothetical2019.07 | 75 | |
| Optimal invariant modeltype=hypothetical2020.12 | 75 | |
| Optimum2020.03 | 75 | |
| ERMinput_type=grayscale, type=oracle2019.07 | 73 | |
| ERM, grayscale modeltype=oracle2020.12 | 73 | |
| Grayscale oracle2020.03 | 73 | |
| DecAug2020.12 | 69.6 | |
| Rex2020.12 | 68.7 | |
| V-RExtuned on test set=false2020.03 | 68.7 | |
| IRM2019.07 | 66.9 | |
| IRM2020.12 | 66.9 | |
| IRMtuned on test set=true2020.03 | 66.9 | |
| MM-RExtuned on test set=true2020.03 | 66.1 | |
| F-IRMGames2020.12 | 59.91 | |
| Random guessingtype=hypothetical2019.07 | 50 | |
| Chance2020.03 | 50 | |
| V-IRMGames2020.12 | 49.06 | |
| ReBiasimplementation=authors' implementation2020.12 | 29.4 | |
| RItuned on test set=true2020.03 | 22.3 | |
| ERM2019.07 | 17.1 | |
| ERMimplementation=authors' implementation2020.12 | 17.1 | |
| ERMtuned on test set=true2020.03 | 17.1 | |
| JiGenimplementation=authors' implementation2020.12 | 11.91 |