Image Classification on CelebA (test)
99.6AccuracyFairNVT
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FairNVTTask=Wearing glasses, Sensitive Attribute=Gender (Male)2026.04 | 99.6 | — | 98.7 | 11.2 | 0.7 | 0.7 | — | — | — | — | — | — | — | |
| FairVPTTask=Wearing glasses, Sensitive Attribute=Gender (Male)2026.04 | 99.4 | — | 97 | 9.6 | 2.1 | 1.2 | — | — | — | — | — | — | — | |
| VanillaTask=Wearing glasses, Sensitive Attribute=Gender (Male)2026.04 | 99.1 | — | 94.1 | 10.8 | 5.3 | 4.3 | — | — | — | — | — | — | — | |
| ViT-FSCLTask=Wearing glasses, Sensitive Attribute=Gender (Male)2026.04 | 99.1 | — | 95 | 10.8 | 3.9 | 2.4 | — | — | — | — | — | — | — | |
| FairViTTask=Wearing glasses, Sensitive Attribute=Gender (Male)2026.04 | 99 | — | 98 | 10 | 0.8 | 0.6 | — | — | — | — | — | — | — | |
| Mixup2025.11 | 95.4 | 57.8 | — | — | — | — | — | — | — | — | — | — | — | |
| CVaRDRO2025.11 | 95.2 | 64.1 | — | — | — | — | — | — | — | — | — | — | — | |
| ERM2025.11 | 95.1 | 62.6 | — | — | — | — | — | — | — | — | — | — | — | |
| Focal2025.11 | 94.9 | 59.1 | — | — | — | — | — | — | — | — | — | — | — | |
| IRM2025.11 | 94.7 | 63 | — | — | — | — | — | — | — | — | — | — | — | |
| LDAM2025.11 | 94.5 | 59.6 | — | — | — | — | — | — | — | — | — | — | — | |
| SqrtReWeight2025.11 | 93.6 | 82.4 | — | — | — | — | — | — | — | — | — | — | — | |
| ElRep2025.11 | 92.8 | 91.4 | — | — | — | — | — | — | — | — | — | — | — | |
| SCER2025.11 | 92.7 | 91.4 | — | — | — | — | — | — | — | — | — | — | — | |
| LISA2025.11 | 92.6 | 86.3 | — | — | — | — | — | — | — | — | — | — | — | |
| MMD2025.11 | 92.5 | 24.4 | — | — | — | — | — | — | — | — | — | — | — | |
| PDE2025.11 | 92.4 | 91 | — | — | — | — | — | — | — | — | — | — | — | |
| PlattDistribution Setting (Base, Post)=(PN,PU)2026.05 | 92.18 | — | — | — | — | — | 0.61 | 5.81 | 0.49 | 0.8 | 7.46 | 0.49 | — | |
| PlattDistribution Setting (Base, Post)=(PN,PN)2026.05 | 92.17 | — | — | — | — | — | 2 | 5.81 | 1 | 2 | 5.81 | 1 | — | |
| PlattDistribution Setting (Base, Post)=(PN,UU)2026.05 | 92.17 | — | — | — | — | — | 0.66 | 5.9 | 0.47 | 0.78 | 5.95 | 0.49 | — | |
| ERMDistribution Setting (Base, Post)=(PN,PN)2026.05 | 92.11 | — | — | — | — | — | 1.68 | 6.05 | 0.6 | 1.68 | 6.05 | 0.6 | — | |
| WLMCDistribution Setting (Base, Post)=(PN,PN)2026.05 | 92.11 | — | — | — | — | — | 1.62 | 5.81 | 0.45 | 1.62 | 5.81 | 0.45 | — | |
| TempDistribution Setting (Base, Post)=(PN,PN)2026.05 | 92.11 | — | — | — | — | — | 2.72 | 6.75 | 0.9 | 2.72 | 6.75 | 0.9 | — | |
| ERMDistribution Setting (Base, Post)=(PN,PU)2026.05 | 92.11 | — | — | — | — | — | 1.68 | 6.05 | 0.6 | 1.86 | 7.46 | 0.66 | — | |
| WLMCDistribution Setting (Base, Post)=(PN,PU)2026.05 | 92.11 | — | — | — | — | — | 1.65 | 5.69 | 0.51 | 1.83 | 7.09 | 0.56 | — | |
| TempDistribution Setting (Base, Post)=(PN,PU)2026.05 | 92.11 | — | — | — | — | — | 1.53 | 5.94 | 0.54 | 1.66 | 7.45 | 0.56 | — | |
| ERMDistribution Setting (Base, Post)=(PN,UU)2026.05 | 92.11 | — | — | — | — | — | 1.68 | 6.05 | 0.6 | 1.75 | 6.53 | 0.62 | — | |
| WLMCDistribution Setting (Base, Post)=(PN,UU)2026.05 | 92.11 | — | — | — | — | — | 1.62 | 5.81 | 0.45 | 1.67 | 6.29 | 0.47 | — | |
| TempDistribution Setting (Base, Post)=(PN,UU)2026.05 | 92.11 | — | — | — | — | — | 1.49 | 5.9 | 0.52 | 1.52 | 6.06 | 0.54 | — | |
| ReSample2025.11 | 92 | 87.4 | — | — | — | — | — | — | — | — | — | — | — | |
| SLDescription=Standard Learning baseline without privacy protection2023.04 | 91.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ReWeight2025.11 | 91.9 | 89.7 | — | — | — | — | — | — | — | — | — | — | — | |
| BSoftmax2025.11 | 91.9 | 83.3 | — | — | — | — | — | — | — | — | — | — | — | |
| DFR2025.11 | 91.9 | 90.4 | — | — | — | — | — | — | — | — | — | — | — | |
| PlattDistribution Setting (Base, Post)=(UU,UU)2026.05 | 91.65 | — | — | — | — | — | 0.65 | 5.99 | 0.53 | 0.78 | 7.41 | 0.53 | — | |
| ERMDistribution Setting (Base, Post)=(UU,UU)2026.05 | 91.49 | — | — | — | — | — | 1.39 | 7.14 | 0.52 | 1.41 | 7.77 | 0.52 | — | |
| WLMCDistribution Setting (Base, Post)=(UU,UU)2026.05 | 91.49 | — | — | — | — | — | 1.38 | 6.91 | 0.47 | 1.41 | 7.81 | 0.47 | — | |
| TempDistribution Setting (Base, Post)=(UU,UU)2026.05 | 91.49 | — | — | — | — | — | 1.32 | 6.97 | 0.49 | 1.37 | 7.68 | 0.51 | — | |
| GroupDRO2025.11 | 91.4 | 89 | — | — | — | — | — | — | — | — | — | — | — | |
| CBLoss2025.11 | 91.2 | 89.4 | — | — | — | — | — | — | — | — | — | — | — | |
| BS+Technique=Batch Shuffle, Enhanced by row permutation=true, Permutation matrix shape=197 x 1972023.04 | 91.1 | — | — | — | — | — | — | — | — | — | — | — | — | |
| WLMCDistribution Setting (Base, Post)=(PU,PU)2026.05 | 91.04 | — | — | — | — | — | 1.23 | 7.14 | 0.53 | 1.39 | 7.94 | 0.55 | — | |
| ERMDistribution Setting (Base, Post)=(PU,PU)2026.05 | 90.97 | — | — | — | — | — | 1.37 | 7.37 | 0.66 | 1.54 | 8.05 | 0.71 | — | |
| TempDistribution Setting (Base, Post)=(PU,PU)2026.05 | 90.97 | — | — | — | — | — | 1.29 | 7.12 | 0.65 | 1.42 | 8.41 | 0.68 | — | |
| PlattDistribution Setting (Base, Post)=(PU,PU)2026.05 | 90.95 | — | — | — | — | — | 1.05 | 7.27 | 0.62 | 1.2 | 7.98 | 0.65 | — | |
| Ensemble2021.06 | 90.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Standard2021.06 | 90.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DecNN2021.06 | 90.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ReDecNN2021.06 | 90.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BSTechnique=Batch Shuffle2023.04 | 90.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP Recursive SPIDERPrivacy budget epsilon=102026.02 | 90.45 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP Recursive SPIDERPrivacy budget epsilon=52026.02 | 90.41 | — | — | — | — | — | — | — | — | — | — | — | — | |
| JTT2025.11 | 90.4 | 70 | — | — | — | — | — | — | — | — | — | — | — | |
| DP Recursive SPIDERPrivacy budget epsilon=0.52026.02 | 90.37 | — | — | — | — | — | — | — | — | — | — | — | — | |
| PrivateDiff MinimaxPrivacy budget epsilon=102026.02 | 90.35 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP Recursive SPIDERPrivacy budget epsilon=12026.02 | 90.32 | — | — | — | — | — | — | — | — | — | — | — | — | |
| LP+Technique=Loss-pass filter, Radius=0.05, Enhanced by row permutation=true, Permutation matrix shape=197 x 1972023.04 | 90.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| PrivateDiff MinimaxPrivacy budget epsilon=52026.02 | 90.14 | — | — | — | — | — | — | — | — | — | — | — | — | |
| LPTechnique=Loss-pass filter, Radius=0.052023.04 | 90.1 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP-SGDAPrivacy budget epsilon=102026.02 | 89.93 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP-SGDAPrivacy budget epsilon=52026.02 | 89.76 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP Double SPIDERPrivacy budget epsilon=52026.02 | 89.38 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP Double SPIDERPrivacy budget epsilon=102026.02 | 89.38 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP Double SPIDERPrivacy budget epsilon=0.52026.02 | 89.37 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP Double SPIDERPrivacy budget epsilon=12026.02 | 89.37 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP-SGDAPrivacy budget epsilon=12026.02 | 89.17 | — | — | — | — | — | — | — | — | — | — | — | — | |
| PrivateDiff MinimaxPrivacy budget epsilon=12026.02 | 89.01 | — | — | — | — | — | — | — | — | — | — | — | — | |
| GNTechnique=Gaussian Noise2023.04 | 88.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| GN+Technique=Gaussian Noise, Enhanced by row permutation=true, Permutation matrix shape=197 x 1972023.04 | 88.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Dropout2021.06 | 88.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BayesNN2021.06 | 88.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| PrivateDiff MinimaxPrivacy budget epsilon=0.52026.02 | 88.18 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP-SGDAPrivacy budget epsilon=0.52026.02 | 88.16 | — | — | — | — | — | — | — | — | — | — | — | — | |
| MC-Dropout2021.06 | 87.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| LfF2025.11 | 81.1 | 53 | — | — | — | — | — | — | — | — | — | — | — | |
| DeNetDMGroup Info Required=false2024.03 | 81.04 | — | — | — | — | — | — | — | — | — | — | — | — | |
| JTTGroup Info Required=false2024.03 | 76.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DFAGroup Info Required=false2024.03 | 65.26 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Causal Meta VAEways=5-way, shots=1-shot, learning_type=unsupervised meta-learning2023.02 | 61.04 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DRCways=5-way, shots=1-shot, learning_type=unsupervised meta-learning2023.02 | 59.67 | — | — | — | — | — | — | — | — | — | — | — | — | |
| STMTways=5-way, shots=1-shot, learning_type=unsupervised meta-learning2023.02 | 58.92 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ERMGroup Info Required=false2024.03 | 47.02 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DARModel=ResNet18, Initialization=Random2026.05 | — | — | — | — | — | — | — | — | — | — | — | — | 97.4 | |
| DARConfig=ResNet-502026.05 | — | — | — | — | — | — | — | — | — | — | — | — | 97.1 | |
| DARConfig=90%2026.05 | — | — | — | — | — | — | — | — | — | — | — | — | 98.2 | |
| DARConfig=Pretrained2026.05 | — | — | — | — | — | — | — | — | — | — | — | — | 98.5 | |
| DFRBias labels=val, Retraining=last layer, Backbone=ResNet-502026.05 | — | 88.3 | — | — | — | — | — | — | — | — | — | — | — | |
| ERMModel=ResNet18, Initialization=Random2026.05 | — | — | — | — | — | — | — | — | — | — | — | — | 90.8 | |
| ERMBias labels=none, Retraining=none2026.05 | — | 43.4 | — | — | — | — | — | — | — | — | — | — | — | |
| Group DROBias labels=train+val, Retraining=full, Backbone=ResNet-502026.05 | — | 88.9 | — | — | — | — | — | — | — | — | — | — | — | |
| JTTBias labels=val, Retraining=full, Backbone=ResNet-502026.05 | — | 81.1 | — | — | — | — | — | — | — | — | — | — | — | |
| Label-Free Bias Identification via Gradient ProbesBias labels=none, Retraining=none2026.05 | — | 53.8 | — | — | — | — | — | — | — | — | — | — | — |