Attribute Classification on CelebA
95.56Avg AccuracyERM
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| ERMSampling=Random2026.05 | 95.56 | 39.63 | — | — | — | — | — | — | |
| ERMBackbone=ResNet-502025.11 | 95.1 | 62.6 | — | — | — | — | — | — | |
| ERMSetting=group-oblivious2022.09 | 94.9 | 47.8 | — | — | — | — | — | — | |
| IRMGroup labels in train set=Yes2022.09 | 94 | 77.8 | — | — | — | — | — | — | |
| IRMGroup labels in train set?=Yes2022.09 | 94 | 77.8 | — | — | — | — | — | — | |
| IRMGroup labels in train set?=Yes2022.09 | 94 | 77.8 | — | — | — | — | — | — | |
| CORALGroup labels in train set=Yes2022.09 | 93.8 | 76.9 | — | — | — | — | — | — | |
| CORALGroup labels in train set?=Yes2022.09 | 93.8 | 76.9 | — | — | — | — | — | — | |
| CORALGroup labels in train set?=Yes2022.09 | 93.8 | 76.9 | — | — | — | — | — | — | |
| IB-IRMGroup labels in train set=Yes2022.09 | 93.6 | 85 | — | — | — | — | — | — | |
| IB-IRMGroup labels in train set?=Yes2022.09 | 93.6 | 85 | — | — | — | — | — | — | |
| IB-IRMGroup labels in train set?=Yes2022.09 | 93.6 | 85 | — | — | — | — | — | — | |
| DomainMixGroup labels in train set=Yes2022.09 | 93.4 | 65.6 | — | — | — | — | — | — | |
| DomainMixGroup labels in train set?=Yes2022.09 | 93.4 | 65.6 | — | — | — | — | — | — | |
| DomainMixGroup labels in train set?=Yes2022.09 | 93.4 | 65.6 | — | — | — | — | — | — | |
| FishGroup labels in train set=Yes2022.09 | 93.1 | 61.2 | — | — | — | — | — | — | |
| FishGroup labels in train set?=Yes2022.09 | 93.1 | 61.2 | — | — | — | — | — | — | |
| FishGroup labels in train set?=Yes2022.09 | 93.1 | 61.2 | — | — | — | — | — | — | |
| ElRepBackbone=ResNet-502025.11 | 92.8 | 91.4 | — | — | — | — | — | — | |
| SCERBackbone=ResNet-502025.11 | 92.7 | 91.4 | — | — | — | — | — | — | |
| LISABackbone=ResNet-502025.11 | 92.6 | 86.3 | — | — | — | — | — | — | |
| LISAGroup labels in train set=Yes2022.09 | 92.4 | 89.3 | — | — | — | — | — | — | |
| LISAGroup labels in train set?=Yes2022.09 | 92.4 | 89.3 | — | — | — | — | — | — | |
| LISAGroup labels in train set?=Yes2022.09 | 92.4 | 89.3 | — | — | — | — | — | — | |
| PDEBackbone=ResNet-502025.11 | 92.4 | 91 | — | — | — | — | — | — | |
| DANNSampling=Uniform Env.2026.05 | 92.23 | 80.93 | — | — | — | — | — | — | |
| V-RExGroup labels in train set=Yes2022.09 | 92.2 | 86.7 | — | — | — | — | — | — | |
| V-RExGroup labels in train set?=Yes2022.09 | 92.2 | 86.7 | — | — | — | — | — | — | |
| V-REXGroup labels in train set?=Yes2022.09 | 92.2 | 86.7 | — | — | — | — | — | — | |
| CORALSampling=Uniform Env.2026.05 | 92.2 | 82.41 | — | — | — | — | — | — | |
| MMDSampling=Uniform Env.2026.05 | 92.19 | 81.3 | — | — | — | — | — | — | |
| GroupDROGroup labels in train set=Yes2022.09 | 92.1 | 87.2 | — | — | — | — | — | — | |
| GroupDROGroup labels in train set?=Yes2022.09 | 92.1 | 87.2 | — | — | — | — | — | — | |
| GroupDROGroup labels in train set?=Yes2022.09 | 92.1 | 87.2 | — | — | — | — | — | — | |
| ReSampleBackbone=ResNet-502025.11 | 92 | 87.4 | — | — | — | — | — | — | |
| GroupDROSampling=Uniform Group2026.05 | 91.94 | 84.07 | — | — | — | — | — | — | |
| eX2L-Soft DiceSampling=Uniform Group2026.05 | 91.7 | 83.33 | — | — | — | — | — | — | |
| GroupDROBackbone=ResNet-502025.11 | 91.4 | 89 | — | — | — | — | — | — | |
| eX2L-SSIMSampling=Uniform Group2026.05 | 91.39 | 80.93 | — | — | — | — | — | — | |
| eX2L-CosineSampling=Uniform Group2026.05 | 91.19 | 84.07 | — | — | — | — | — | — | |
| IRMSampling=Uniform Env.2026.05 | 91.17 | 82.04 | — | — | — | — | — | — | |
| eX2L-MAESampling=Uniform Group2026.05 | 90.79 | 82.59 | — | — | — | — | — | — | |
| CDANSampling=Uniform Env.2026.05 | 90.16 | 80.56 | — | — | — | — | — | — | |
| UMIXGroup labels in train set=No2022.09 | 90.1 | 85.3 | — | — | — | — | — | — | |
| UMIXGroup labels in train set?=No2022.09 | 90.1 | 85.3 | — | — | — | — | — | — | |
| UMIXGroup labels in train set?=No2022.09 | 90.1 | 85.3 | — | — | — | — | — | — | |
| eX2L-JS Dist.Sampling=Uniform Group2026.05 | 90.05 | 84.07 | — | — | — | — | — | — | |
| CVaR-DOROSetting=group-oblivious2022.09 | 89.6 | 75.6 | — | — | — | — | — | — | |
| FairViTBackbone=ViT, Implementation=Our re-implementation2026.02 | 89.3 | — | 4.7 | — | — | — | — | — | |
| SHASAMBackbone=ViT, Variant=w/ FLCMI, ViT2026.02 | 89.2 | — | 3.7 | — | — | — | — | — | |
| Focal LossSetting=group-oblivious2022.09 | 88.4 | 72.1 | — | — | — | — | — | — | |
| FairMTParadigm=Head-Aware Fairness Adjustment2025.11 | 88.4 | — | 2 | 3.4 | — | — | — | — | |
| CentralClassifier=MLP2024.03 | 88.4 | — | — | — | — | — | — | — | |
| FSCLBackbone=ViT, Variant=w/ ViT2026.02 | 88.2 | — | 4.6 | — | — | — | — | — | |
| SHASAMBackbone=ViT, Variant=w/ FLCMI, ViT2026.02 | 88.2 | — | 2.8 | — | — | — | — | — | |
| FairViTBackbone=ViT, Implementation=Our re-implementation2026.02 | 88.1 | — | 3.4 | — | — | — | — | — | |
| FairMTParadigm=Head-Aware Fairness Adjustment2025.11 | 88.1 | — | 3.9 | 6.4 | — | — | — | — | |
| JTTSetting=group-oblivious2022.09 | 88 | 81.1 | — | — | — | — | — | — | |
| x2-DROSetting=group-oblivious2022.09 | 87.7 | 78.4 | — | — | — | — | — | — | |
| FSCLBackbone=ViT, Variant=w/ ViT2026.02 | 87.7 | — | 2.9 | — | — | — | — | — | |
| MGDAParadigm=Multi-task baseline2025.11 | 87.7 | — | 10.4 | 11.4 | — | — | — | — | |
| MGDAParadigm=Multi-task baseline2025.11 | 87.7 | — | 22.3 | 22.5 | — | — | — | — | |
| x2-DOROSetting=group-oblivious2022.09 | 87 | 75.6 | — | — | — | — | — | — | |
| SHASAMBackbone=Standard, Variant=w/ FLCMI2026.02 | 87 | — | 3.9 | — | — | — | — | — | |
| CVaR-DROSetting=group-oblivious2022.09 | 86.8 | 76.9 | — | — | — | — | — | — | |
| FairViTBackbone=ViT, Implementation=Our re-implementation2026.02 | 86.8 | — | 1.8 | — | — | — | — | — | |
| SHASAMBackbone=ViT, Variant=w/ FLCMI, ViT2026.02 | 86.8 | — | 1.6 | — | — | — | — | — | |
| Imakura-DCSecret Bases=SameSpan-Orth, Classifier=MLP2024.03 | 86.5 | — | — | — | — | — | — | — | |
| FSCLBackbone=ViT, Variant=w/ ViT2026.02 | 86.3 | — | 1.7 | — | — | — | — | — | |
| Imakura-DCSecret Bases=SameSpan, Classifier=MLP2024.03 | 86.3 | — | — | — | — | — | — | — | |
| Kawakami-DCSecret Bases=SameSpan-Orth, Classifier=MLP2024.03 | 86.2 | — | — | — | — | — | — | — | |
| ODCSecret Bases=SameSpan-Orth, Classifier=MLP2024.03 | 86.2 | — | — | — | — | — | — | — | |
| FairViTBackbone=ViT, Implementation=Our re-implementation2026.02 | 86.1 | — | 5.1 | — | — | — | — | — | |
| SHASAMBackbone=Standard, Variant=w/ LogDetCMI2026.02 | 85.9 | — | 4.2 | — | — | — | — | — | |
| SHASAMBackbone=Standard, Variant=w/ FLCMI2026.02 | 85.8 | — | 2.6 | — | — | — | — | — | |
| Kawakami-DCSecret Bases=SameSpan, Classifier=MLP2024.03 | 85.8 | — | — | — | — | — | — | — | |
| SHASAMBackbone=ViT, Variant=w/ FLCMI, ViT2026.02 | 85.6 | — | 3 | — | — | — | — | — | |
| FSCLBackbone=ViT, Variant=w/ ViT2026.02 | 85 | — | 4 | — | — | — | — | — | |
| SHASAMBackbone=Standard, Variant=w/ LogDetCMI2026.02 | 85 | — | 2.7 | — | — | — | — | — | |
| GradNormParadigm=Multi-task baseline2025.11 | 84.8 | — | 8.4 | 9.4 | — | — | — | — | |
| GradNormParadigm=Multi-task baseline2025.11 | 84.8 | — | 18.3 | 19.4 | — | — | — | — | |
| SHASAMBackbone=Standard, Variant=w/ FLCMI2026.02 | 84.7 | — | 3.3 | — | — | — | — | — | |
| SupConBackbone=Standard2026.02 | 84.6 | — | 20.7 | — | — | — | — | — | |
| C_true → Y2025.06 | 84.51 | — | — | — | — | — | — | — | |
| SHASAMBackbone=Standard, Variant=w/ LogDetCMI2026.02 | 84.5 | — | 3.6 | — | — | — | — | — | |
| CEBackbone=Standard2026.02 | 84.5 | — | 14.7 | — | — | — | — | — | |
| SupConBackbone=Standard2026.02 | 84.4 | — | 16.9 | — | — | — | — | — | |
| SHASAMBackbone=Standard, Variant=w/ FLCMI2026.02 | 84.4 | — | 1.6 | — | — | — | — | — | |
| SupConBackbone=Standard2026.02 | 84.3 | — | 20.8 | — | — | — | — | — | |
| FSCLBackbone=Standard, Implementation=Our re-implementation, Config=w/ group norm2026.02 | 84.1 | — | 4.8 | — | — | — | — | — | |
| CEBackbone=Standard2026.02 | 84 | — | 17.6 | — | — | — | — | — | |
| FD-VAEBackbone=Standard2026.02 | 84 | — | 6.2 | — | — | — | — | — | |
| SupConBackbone=Standard2026.02 | 84 | — | 10.8 | — | — | — | — | — | |
| SHASAMBackbone=Standard, Variant=w/ LogDetCMI2026.02 | 84 | — | 1.7 | — | — | — | — | — | |
| CEBackbone=Standard2026.02 | 83.9 | — | 15 | — | — | — | — | — | |
| CEBackbone=Standard2026.02 | 83.8 | — | 12.7 | — | — | — | — | — | |
| DPSecret Bases=SameSpan-Orth, Privacy budget (ε)=8, Classifier=MLP2024.03 | 83.8 | — | — | — | — | — | — | — | |
| DPSecret Bases=SameSpan, Privacy budget (ε)=8, Classifier=MLP2024.03 | 83.8 | — | — | — | — | — | — | — | |
| DPSecret Bases=DiffSpan-Orth, Privacy budget (ε)=8, Classifier=MLP2024.03 | 83.8 | — | — | — | — | — | — | — | |
| DPSecret Bases=DiffSpan, Privacy budget (ε)=8, Classifier=MLP2024.03 | 83.8 | — | — | — | — | — | — | — |