Image Classification on ColoredMNIST (CMNIST) (test)
72.1AccuracyOracle
Evaluation Results
| Method | Links | |
|---|---|---|
| OracleInitialization=Combined2022.07 | 72.1 | |
| V-REXInitialization=ERM2022.07 | 71.6 | |
| EQRMInitialization=ERM2022.07 | 71.4 | |
| SDInitialization=ERM2022.07 | 70.3 | |
| IRMInitialization=ERM2022.07 | 69.7 | |
| IGAInitialization=ERM2022.07 | 57.7 | |
| V-REXInitialization=Rand.2022.07 | 55.2 | |
| EQRMInitialization=Rand.2022.07 | 53.4 | |
| IRMInitialization=Rand.2022.07 | 52.5 | |
| IRM2021.11 | 51.8 | |
| MILe2021.11 | 51.8 | |
| ERM2021.11 | 51.6 | |
| REx2021.11 | 51.6 | |
| IGAInitialization=Rand.2022.07 | 50.7 | |
| SDInitialization=Rand.2022.07 | 49.4 | |
| GrpDROInitialization=ERM2022.07 | 29 | |
| ERMInitialization=Rand.2022.07 | 27.9 | |
| ERMInitialization=ERM2022.07 | 27.9 | |
| GrpDROInitialization=Rand.2022.07 | 27.3 |