Zero-shot Classification Fairness on Waterbirds Background
88.6Accuracy (Zero-shot)PRISM
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PRISMBackbone=ResNet-50, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 88.6 | 63.4 | 25.2 | |
| BENDSEMbiBackbone=ResNet-101, Prompting Strategy=Bias prompts + input-specific prompts + labeled images, Zero-shot=false2026.03 | 88.1 | 63.8 | 24.3 | |
| SEMbiBackbone=ResNet-101, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 87.1 | 54.1 | 33 | |
| SEMbiBackbone=ResNet-50, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 86.4 | 52.5 | 33.8 | |
| ORTH-PROJBackbone=ResNet-50, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 85.9 | 45.7 | 40.2 | |
| PRISM-MINIBackbone=ResNet-50, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 85.9 | 45.7 | 40.2 | |
| ORTH-PROJBackbone=ResNet-101, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 85.8 | 40.1 | 45.7 | |
| PRISM-MINIBackbone=ResNet-101, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 85.8 | 40.1 | 45.7 | |
| BENDSEMbiBackbone=ResNet-50, Prompting Strategy=Bias prompts + input-specific prompts + labeled images, Zero-shot=false2026.03 | 85.6 | 64.8 | 20.8 | |
| SEMiBackbone=ResNet-50, Prompting Strategy=Bias-agnostic + input-specific prompts, Zero-shot=true2026.03 | 85.1 | 55.7 | 29.5 | |
| SEMbBackbone=ResNet-101, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 84.6 | 58.8 | 25.8 | |
| SEMbBackbone=ResNet-50, Prompting Strategy=Bias prompts only, Zero-shot=true2026.03 | 84.5 | 57.7 | 26.9 | |
| SEMiBackbone=ResNet-101, Prompting Strategy=Bias-agnostic + input-specific prompts, Zero-shot=true2026.03 | 84.3 | 58.1 | 26.2 | |
| PRISMBackbone=ResNet-101, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 84 | 67.2 | 16.8 | |
| BASE CLIPBackbone=ResNet-50, Prompting Strategy=Baseline, Zero-shot=true2026.03 | 83.7 | 39.4 | 44.2 | |
| BENDVLMBackbone=ResNet-50, Prompting Strategy=Bias prompts + input-specific prompts + labeled images, Zero-shot=false2026.03 | 82.6 | 61.1 | 21.5 | |
| ORTH-CALIBackbone=ResNet-101, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 82.3 | 55.4 | 26.9 | |
| BENDVLMBackbone=ResNet-101, Prompting Strategy=Bias prompts + input-specific prompts + labeled images, Zero-shot=false2026.03 | 81.2 | 19.4 | 61.8 | |
| ORTH-CALIBackbone=ResNet-50, Prompting Strategy=Bias prompts + input-specific prompts, Zero-shot=true2026.03 | 80.8 | 70.4 | 10.4 | |
| ZSDEBIASBackbone=ResNet-50, Prompting Strategy=Bias prompts only, Zero-shot=false2026.03 | 80.2 | 14.8 | 65.4 | |
| BASE CLIPBackbone=ResNet-101, Prompting Strategy=Baseline, Zero-shot=true2026.03 | 80.1 | 49.9 | 30.1 | |
| ZSDEBIASBackbone=ResNet-101, Prompting Strategy=Bias prompts only, Zero-shot=false2026.03 | 77.4 | 39.8 | 37.6 | |
| ROBOSHOTBackbone=ResNet-50, Prompting Strategy=Bias-agnostic + input-specific prompts, Zero-shot=true2026.03 | 76.2 | 45.8 | 30.4 | |
| ROBOSHOTBackbone=ResNet-101, Prompting Strategy=Bias-agnostic + input-specific prompts, Zero-shot=true2026.03 | 76.1 | 45 | 31 |