Attribute Classification on CelebA (test)
69.58Average Worst-Group AccuracyProposed + G + P
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Proposed + G + PContext size=5122024.10 | 69.58 | — | — | — | — | |
| Proposed + PContext size=5122024.10 | 68.45 | — | — | — | — | |
| Proposed + G + PContext size=2562024.10 | 64.39 | — | — | — | — | |
| Proposed + G + PContext size=5122024.10 | 61.74 | — | — | — | — | |
| GroupDROContext size=5122024.10 | 61.47 | — | — | — | — | |
| Proposed + PContext size=2562024.10 | 60.48 | — | — | — | — | |
| Proposed + G + PContext size=1282024.10 | 59.37 | — | — | — | — | |
| Proposed + PContext size=5122024.10 | 55.53 | — | — | — | — | |
| Proposed + PContext size=1282024.10 | 54.66 | — | — | — | — | |
| Proposed + G + PContext size=642024.10 | 53.41 | — | — | — | — | |
| ERMContext size=5122024.10 | 49.92 | — | — | — | — | |
| Proposed + PContext size=642024.10 | 47.29 | — | — | — | — | |
| Proposed + G + PContext size=322024.10 | 46.13 | — | — | — | — | |
| Proposed + G + PContext size=162024.10 | 39.21 | — | — | — | — | |
| 1-NNContext size=5122024.10 | 37.81 | — | — | — | — | |
| Proposed + PContext size=322024.10 | 37.3 | — | — | — | — | |
| 1-NNContext size=42024.10 | 35.87 | — | — | — | — | |
| Proposed + PContext size=42024.10 | 35.13 | — | — | — | — | |
| Proposed + G + PContext size=82024.10 | 32.06 | — | — | — | — | |
| Proposed + G + PContext size=42024.10 | 31.44 | — | — | — | — | |
| ProposedContext size=5122024.10 | 27.53 | — | — | — | — | |
| Proposed + PContext size=162024.10 | 27 | — | — | — | — | |
| Proposed + PContext size=42024.10 | 26.9 | — | — | — | — | |
| ProposedContext size=2562024.10 | 26.89 | — | — | — | — | |
| ProposedContext size=162024.10 | 26.85 | — | — | — | — | |
| Proposed + G + PContext size=42024.10 | 26.71 | — | — | — | — | |
| ProposedContext size=1282024.10 | 26.65 | — | — | — | — | |
| Proposed + GContext size=5122024.10 | 26.55 | — | — | — | — | |
| Proposed + PContext size=82024.10 | 26.54 | — | — | — | — | |
| NaiveContext size=5122024.10 | 26.2 | — | — | — | — | |
| Naive + PContext size=5122024.10 | 26.03 | — | — | — | — | |
| NaiveContext size=2562024.10 | 25.84 | — | — | — | — | |
| ProposedContext size=42024.10 | 25.83 | — | — | — | — | |
| NaiveContext size=162024.10 | 25.8 | — | — | — | — | |
| ProposedContext size=322024.10 | 25.8 | — | — | — | — | |
| Proposed + GContext size=1282024.10 | 25.77 | — | — | — | — | |
| Proposed + GContext size=2562024.10 | 25.7 | — | — | — | — | |
| NaiveContext size=1282024.10 | 25.62 | — | — | — | — | |
| Proposed + GContext size=162024.10 | 25.6 | — | — | — | — | |
| ProposedContext size=82024.10 | 25.42 | — | — | — | — | |
| ProposedContext size=642024.10 | 25.18 | — | — | — | — | |
| NaiveContext size=322024.10 | 25.14 | — | — | — | — | |
| Proposed + GContext size=322024.10 | 24.95 | — | — | — | — | |
| NaiveContext size=42024.10 | 24.88 | — | — | — | — | |
| Proposed + GContext size=82024.10 | 24.67 | — | — | — | — | |
| NaiveContext size=82024.10 | 24.56 | — | — | — | — | |
| NaiveContext size=42024.10 | 24.43 | — | — | — | — | |
| Proposed + GContext size=642024.10 | 24.42 | — | — | — | — | |
| Proposed + GContext size=42024.10 | 23.87 | — | — | — | — | |
| NaiveContext size=642024.10 | 23.85 | — | — | — | — | |
| Naive + PContext size=5122024.10 | 21.67 | — | — | — | — | |
| Naive + PContext size=42024.10 | 20.72 | — | — | — | — | |
| NaiveContext size=5122024.10 | 20.22 | — | — | — | — | |
| Naive + PContext size=2562024.10 | 20.16 | — | — | — | — | |
| ProposedContext size=5122024.10 | 19.54 | — | — | — | — | |
| Naive + PContext size=82024.10 | 17.27 | — | — | — | — | |
| Naive + PContext size=1282024.10 | 16.17 | — | — | — | — | |
| Naive + PContext size=322024.10 | 14.85 | — | — | — | — | |
| Naive + PContext size=642024.10 | 13.56 | — | — | — | — | |
| Naive + PContext size=162024.10 | 12.43 | — | — | — | — | |
| BaseTarget Attribute=Blond Hair, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 80.42 | 41.02 | — | — | |
| BaseTarget Attribute=Heavy Makeup, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 71.19 | 17.35 | — | — | |
| BaseTarget Attribute=Average, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 72.67 | 39.91 | — | — | |
| BPATarget Attribute=Blond Hair, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 90.18 | 82.54 | — | — | |
| BPATarget Attribute=Heavy Makeup, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 73.78 | 39.84 | — | — | |
| BPATarget Attribute=Pale Skin, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 90.06 | 88.6 | — | — | |
| BPATarget Attribute=Wearing Lipstick, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 78.28 | 46.52 | — | — | |
| BPATarget Attribute=Young, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 82.27 | 74.33 | — | — | |
| BPATarget Attribute=Double Chin, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 82.92 | 67.78 | — | — | |
| BPATarget Attribute=Chubby, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 83.88 | 72.32 | — | — | |
| BPATarget Attribute=Wearing Hat, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 96.8 | 94.94 | — | — | |
| BPATarget Attribute=Oval Face, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 67.18 | 55.78 | — | — | |
| BPATarget Attribute=Pointy Nose, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 68.9 | 52.48 | — | — | |
| BPATarget Attribute=Straight Hair, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 79.18 | 72.09 | — | — | |
| BPATarget Attribute=Blurry, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 88.93 | 84.1 | — | — | |
| BPATarget Attribute=Narrow Eyes, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 76.39 | 73.24 | — | — | |
| BPATarget Attribute=Arched Eyebrows, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 74.77 | 54.36 | — | — | |
| BPATarget Attribute=Bags Under Eyes, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 77.84 | 62.55 | — | — | |
| BPATarget Attribute=Bangs, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 93.94 | 92.21 | — | — | |
| BPATarget Attribute=Big Lips, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 66.5 | 56.99 | — | — | |
| BPATarget Attribute=No Beard, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 79.58 | 40 | — | — | |
| BPATarget Attribute=Receding Hairline, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 84.95 | 79.11 | — | — | |
| BPATarget Attribute=Wavy Hair, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 79.89 | 65.74 | — | — | |
| BPATarget Attribute=Wearing Earrings, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 84.57 | 72.81 | — | — | |
| BPATarget Attribute=Wearing Necklace, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 68.96 | 41.93 | — | — | |
| BPATarget Attribute=Average, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 81.74 | 69.84 | — | — | |
| CIMModel=ResNet-50, # Trained Params=25557032, % Params=1002022.07 | — | — | 83.6 | -6.2 | — | |
| CNCModel=ResNet-50, # Trained Params=25557032, % Params=1002022.07 | — | — | 88.8 | -1 | — | |
| Contrastive Adapter (CLIP RN-50)Model=Adapter + CLIP RN-50, # Trained Params=263424, % Params=1.032022.07 | — | — | 90 | 0.2 | — | |
| Contrastive Adapter (CLIP ViT-L/14)Model=Adapter + CLIP ViT-L/14, # Trained Params=197632, % Params=0.772022.07 | — | — | 84.6 | -5.2 | — | |
| EIILModel=ResNet-50, # Trained Params=25557032, % Params=1002022.07 | — | — | 83.3 | -6.5 | — | |
| ERMms=0.44, mt=0.492022.11 | — | — | 80.83 | — | 95.93 | |
| gDROms=0.44, mt=0.492022.11 | — | — | 87.36 | — | 94.68 | |
| Group DROTarget Attribute=Blond Hair, Bias Attribute=Gender, Learning Paradigm=Supervised, Backbone=ResNet-182021.08 | — | 91.39 | 87.86 | — | — | |
| Group DROTarget Attribute=Heavy Makeup, Bias Attribute=Gender, Learning Paradigm=Supervised, Backbone=ResNet-182021.08 | — | 72.7 | 21.36 | — | — | |
| Group DROTarget Attribute=Average, Bias Attribute=Gender, Learning Paradigm=Supervised, Backbone=ResNet-182021.08 | — | 80.87 | 69.68 | — | — | |
| JTTModel=ResNet-50, # Trained Params=25557032, % Params=1002022.07 | — | — | 81.1 | -8.7 | — | |
| LA/TTLSAms=0.44, mt=0.492022.11 | — | — | 84.72 | — | 95.55 | |
| LfFTarget Attribute=Blond Hair, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 59.46 | 34.23 | — | — | |
| LfFTarget Attribute=Heavy Makeup, Bias Attribute=Gender, Learning Paradigm=Unsupervised, Backbone=ResNet-182021.08 | — | 56.34 | 30.81 | — | — |