Blond Hair Classification on CelebA (test)
97.8Average Group AccuracyERM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ERM2022.10 | 97.8 | 47.02 | — | |
| DCWPPruning=false2022.10 | 95.89 | 67.85 | — | |
| ERMGT bias labels=false2023.01 | 94.9 | 47.7 | — | |
| GEORGEGT bias labels=false2023.01 | 94.6 | 54.9 | — | |
| DCWPPruning=true2022.10 | 94.5 | 79.3 | — | |
| JTT2022.10 | 93.98 | 76.8 | — | |
| DROGT bias labels=true2023.01 | 93.3 | 90 | — | |
| DRO-B2TGT bias labels=false2023.01 | 93.2 | 90.4 | — | |
| UWMethod Category=Sampling2022.09 | 91.6 | — | 88.3 | |
| USMethod Category=Sampling2022.09 | 91.1 | — | 88.5 | |
| DIMethod Category=Non Sampling2022.09 | 90.9 | — | 86.1 | |
| BMMethod Category=Sampling2022.09 | 90.8 | — | 87.1 | |
| G-DROMethod Category=Non Sampling2022.09 | 90.4 | — | 89.4 | |
| BC+BBMethod Category=Non Sampling2022.09 | 90.4 | — | 86.5 | |
| CNCGT bias labels=false2023.01 | 89.9 | 88.8 | — | |
| OSMethod Category=Sampling2022.09 | 88.1 | — | 80.1 | |
| JTTGT bias labels=false2023.01 | 88.1 | 81.5 | — | |
| LfFGT bias labels=false2023.01 | 85.1 | 77.2 | — | |
| VanillaMethod Category=Non Sampling2022.09 | 82.4 | — | 66.3 | |
| AdvMethod Category=Non Sampling2022.09 | 82.4 | — | 66.3 | |
| Chroma-VAE2022.11 | 82 | 54.4 | — | |
| CFKDCorrelation Parameter=0.96, Samples=10002025.10 | 79.1 | — | — | |
| DiDAE-CFKD2026.01 | 78.3 | — | — | |
| DFR2026.01 | 77.5 | — | — | |
| DFRCorrelation Parameter=0.96, Samples=10002025.10 | 77.5 | — | — | |
| RR-ClArC2026.01 | 74.5 | — | — | |
| RR-ClArCCorrelation Parameter=0.96, Samples=10002025.10 | 74.5 | — | — | |
| P-ClArC2026.01 | 74.4 | — | — | |
| P-ClArCCorrelation Parameter=0.96, Samples=10002025.10 | 74.4 | — | — | |
| Original2026.01 | 74.3 | — | — | |
| GroupDRO2026.01 | 73 | — | — | |
| GroupDROCorrelation Parameter=0.96, Samples=10002025.10 | 73 | — | — | |
| OriginalCorrelation Parameter=0.96, Samples=10002025.10 | 72.7 | — | — | |
| DiffAugCorrelation Parameter=0.96, Samples=10002025.10 | 72.7 | — | — | |
| DisEnt2022.10 | 67.88 | 65.26 | — | |
| JTT2022.11 | 65.3 | 28.3 | — | |
| Naive-Class2022.11 | 64.2 | 29.4 | — |