Image Classification on CMNIST (test)
93.54Test AccuracyDeNetDM
Evaluation results
| Method | Links | |
|---|---|---|
| DeNetDMGroup Info Required=false, Bias-conflicting ratio=5.0%2024.03 | 93.54 | |
| OracleAdaptation=true, seeds=102023.07 | 89.9 | |
| DeNetDMGroup Info Required=false, Bias-conflicting ratio=2.0%2024.03 | 89.29 | |
| DFAGroup Info Required=false, Bias-conflicting ratio=5.0%2024.03 | 88.29 | |
| LCGroup Info Required=false, Bias-conflicting ratio=5.0%2024.03 | 88.18 | |
| SFBAdaptation=true, seeds=102023.07 | 88.1 | |
| LfFGroup Info Required=false, Bias-conflicting ratio=5.0%2024.03 | 85.39 | |
| DeNetDMGroup Info Required=false, Bias-conflicting ratio=1.0%2024.03 | 85.22 | |
| JTTGroup Info Required=false, Bias-conflicting ratio=5.0%2024.03 | 85.03 | |
| Group DROGroup Info Required=true, Bias-conflicting ratio=5.0%2024.03 | 84.4 | |
| LCGroup Info Required=false, Bias-conflicting ratio=2.0%2024.03 | 83.63 | |
| DFAGroup Info Required=false, Bias-conflicting ratio=2.0%2024.03 | 82.86 | |
| LfFGroup Info Required=false, Bias-conflicting ratio=2.0%2024.03 | 80.48 | |
| LCGroup Info Required=false, Bias-conflicting ratio=1.0%2024.03 | 78.41 | |
| ERMGroup Info Required=false, Bias-conflicting ratio=5.0%2024.03 | 77.63 | |
| Group DROGroup Info Required=true, Bias-conflicting ratio=2.0%2024.03 | 76.3 | |
| DeNetDMGroup Info Required=false, Bias-conflicting ratio=0.5%2024.03 | 74.72 | |
| JTTGroup Info Required=false, Bias-conflicting ratio=2.0%2024.03 | 74.23 | |
| LfFGroup Info Required=false, Bias-conflicting ratio=1.0%2024.03 | 74.01 | |
| GroupDRO (with Tgt)Group label=✓2026.01 | 73.1 | |
| OracleAdaptation=false, seeds=102023.07 | 72.1 | |
| V-RExseeds=102023.07 | 71.6 | |
| EQRMseeds=102023.07 | 71.4 | |
| Group DROGroup Info Required=true, Bias-conflicting ratio=1.0%2024.03 | 71.33 | |
| DFAGroup Info Required=false, Bias-conflicting ratio=1.0%2024.03 | 71.04 | |
| SFBAdaptation=false, seeds=102023.07 | 70.6 | |
| SDseeds=102023.07 | 70.3 | |
| Fishrseeds=102023.07 | 70.1 | |
| IRMseeds=102023.07 | 69.7 | |
| LCGroup Info Required=false, Bias-conflicting ratio=0.5%2024.03 | 63.48 | |
| LfFGroup Info Required=false, Bias-conflicting ratio=0.5%2024.03 | 63.39 | |
| ERMGroup Info Required=false, Bias-conflicting ratio=2.0%2024.03 | 62.29 | |
| JTTGroup Info Required=false, Bias-conflicting ratio=1.0%2024.03 | 61.68 | |
| Group DROGroup Info Required=true, Bias-conflicting ratio=0.5%2024.03 | 59.67 | |
| DFAGroup Info Required=false, Bias-conflicting ratio=0.5%2024.03 | 59.12 | |
| IGAseeds=102023.07 | 57.7 | |
| JTTGroup Info Required=false, Bias-conflicting ratio=0.5%2024.03 | 53.03 | |
| ERMGroup Info Required=false, Bias-conflicting ratio=1.0%2024.03 | 50.34 | |
| ERMGroup Info Required=false, Bias-conflicting ratio=0.5%2024.03 | 35.34 | |
| GroupDROseeds=102023.07 | 29 | |
| ERMseeds=102023.07 | 27.9 | |
| Ours (ERM)Group label=×2026.01 | 7.5 | |
| *Ours (ERM)Group label=×2026.01 | 4.9 | |
| ICONGroup label=×2026.01 | 4.4 | |
| GroupDROGroup label=✓2026.01 | 3.4 | |
| ATDOCGroup label=×2026.01 | 3.1 | |
| MK-MMDGroup label=×2026.01 | 2.8 | |
| STARGroup label=×2026.01 | 2.2 | |
| MCDGroup label=×2026.01 | 1.9 | |
| CORALGroup label=×2026.01 | 1.7 | |
| PDEGroup label=✓2026.01 | 1.3 | |
| CDANGroup label=×2026.01 | 1.2 | |
| DRSTGroup label=×2026.01 | 1 | |
| ERM (Src-only)Group label=×2026.01 | 0.9 | |
| DANNGroup label=×2026.01 | 0.9 |