Zero-shot Fairness Classification on CelebA
85.1AccuracySEMbi
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SEMbiBackbone=ResNet-50, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 85.1 | 80.3 | 4.8 | |
| BENDSEMbiBackbone=ResNet-50, Prompting Strategy=Bias prompts + input-specific prompts + labeled images, Zero-shot=false2026.03 | 84.8 | 81.5 | 3.3 | |
| SEMbBackbone=ResNet-50, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 84.7 | 79.8 | 4.9 | |
| ROBOSHOTBackbone=ResNet-50, Prompting Strategy=Bias-agnostic + input-specific prompts, Zero-shot=true2026.03 | 84.1 | 80.6 | 3.5 | |
| SEMiBackbone=ResNet-50, Prompting Strategy=Bias-agnostic + input-specific prompts, Zero-shot=true2026.03 | 83.5 | 79.9 | 3.6 | |
| ORTH-CALIBackbone=ResNet-50, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 83.1 | 80.1 | 3 | |
| PRISMBackbone=ResNet-50, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 82.4 | 76.3 | 6.1 | |
| BASE CLIPBackbone=ResNet-50, Prompting Strategy=Baseline, Zero-shot=true2026.03 | 82 | 76.8 | 5.3 | |
| SEMiBackbone=ResNet-101, Prompting Strategy=Bias-agnostic + input-specific prompts, Zero-shot=true2026.03 | 81.1 | 75.8 | 5.2 | |
| BENDVLMBackbone=ResNet-50, Prompting Strategy=Bias prompts + input-specific prompts + labeled images, Zero-shot=false2026.03 | 80.9 | 71.5 | 9.4 | |
| ORTH-PROJBackbone=ResNet-50, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 79.5 | 72.2 | 7.3 | |
| PRISM-MINIBackbone=ResNet-50, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 79.5 | 72.2 | 7.3 | |
| SEMbBackbone=ResNet-101, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 79.5 | 75 | 4.5 | |
| SEMbiBackbone=ResNet-101, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 79.1 | 74.1 | 4.9 | |
| PRISMBackbone=ResNet-101, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 78.8 | 68.8 | 10 | |
| BENDSEMbiBackbone=ResNet-101, Prompting Strategy=Bias prompts + input-specific prompts + labeled images, Zero-shot=false2026.03 | 78.4 | 69.9 | 8.6 | |
| ROBOSHOTBackbone=ResNet-101, Prompting Strategy=Bias-agnostic + input-specific prompts, Zero-shot=true2026.03 | 73.7 | 59.6 | 14 | |
| BENDVLMBackbone=ResNet-101, Prompting Strategy=Bias prompts + input-specific prompts + labeled images, Zero-shot=false2026.03 | 70.2 | 49 | 21.2 | |
| ZSDEBIASBackbone=ResNet-50, Prompting Strategy=Bias prompts only, Zero-shot=false2026.03 | 69.5 | 58.9 | 10.6 | |
| BASE CLIPBackbone=ResNet-101, Prompting Strategy=Baseline, Zero-shot=true2026.03 | 68.9 | 50.2 | 18.8 | |
| ORTH-CALIBackbone=ResNet-101, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 67.9 | 50.5 | 17.4 | |
| ORTH-PROJBackbone=ResNet-101, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 67.5 | 48.6 | 18.9 | |
| PRISM-MINIBackbone=ResNet-101, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 67.5 | 48.6 | 18.9 | |
| ZSDEBIASBackbone=ResNet-101, Prompting Strategy=Bias prompts only, Zero-shot=false2026.03 | 56.5 | 46 | 10.6 |