Image Classification on C-MNIST (test)
99.3AccuracyBase (ERM)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Base (ERM)Group Info (Train/Val)=X/X2024.03 | 99.3 | 39.6 | |
| RICE2022.03 | 96.9 | — | |
| GEORGE (DFR)Group Info (Train/Val)=X/X2024.03 | 95.2 | 71.7 | |
| DFR+ExMapGroup Info (Train/Val)=X/X2024.03 | 94.9 | 72.5 | |
| DFRGroup Info (Train/Val)=X/✓2024.03 | 93.7 | 74.2 | |
| DFRGroup Info Train=false, Group Info Val=true2026.06 | 93.7 | 74.2 | |
| GB ERMGroup Info Train=true, Group Info Val=true2026.06 | 91.83 | 81.46 | |
| TCSL-CS (ERM)Group Info Train=false, Group Info Val=false2026.06 | 91.76 | 83.37 | |
| CNCGroup Info Train=false, Group Info Val=true2026.06 | 90.9 | 77.4 | |
| EIILGroup Info Train=false, Group Info Val=false2026.06 | 90.7 | 72.8 | |
| GEORGEGroup Info Train=false, Group Info Val=false2026.06 | 89.5 | 76.4 | |
| GroupDROGroup Info Train=true, Group Info Val=true2026.06 | 76.56 | 58.66 | |
| CB ERMGroup Info Train=false, Group Info Val=false2026.06 | 76.01 | 56.61 | |
| DANN2022.03 | 28.1 | — | |
| Mixup2022.03 | 17.5 | — | |
| IRM2022.03 | 15.8 | — | |
| MTL2022.03 | 14.7 | — | |
| GroupDRO2022.03 | 14.1 | — | |
| ERM2022.03 | 13.3 | — | |
| JTTGroup Info Train=false, Group Info Val=true2026.06 | — | 74.04 | |
| LCGroup Info Train=false, Group Info Val=true2026.06 | — | 71.25 | |
| LfFGroup Info Train=false, Group Info Val=true2026.06 | — | 77 | |
| ULAGroup Info Train=false, Group Info Val=true2026.06 | — | 75.13 |