List your company
ResearchFormerly WizWand

Social Bias Evaluation on FairFace

0.079MSBENDSEMbi
0.042320.289910.53750.78509Nov 19, 2024Feb 25, 2025Jun 3, 2025Sep 9, 2025Dec 16, 2025Mar 24, 2026Jul 1, 2026
Updated 4mo ago

Evaluation results

MethodLinks
BENDSEMbiBackbone=ResNet-50, Zero-shot=false, Prompting Category=Bias prompts + input-specific prompts + labeled images2026.030.0790.005—
BENDVLMBackbone=ResNet-50, Zero-shot=false, Prompting Category=Bias prompts + input-specific prompts + labeled images2026.030.0810.006—
BENDSEMbiBackbone=ResNet-101, Zero-shot=false, Prompting Category=Bias prompts + input-specific prompts + labeled images2026.030.0870.006—
Ours (gender)Backbone=ViT-B/16, Training Dataset=FairFace, Evaluation Attribute=gender2024.110.1010.032—
BENDVLMBackbone=ResNet-101, Zero-shot=false, Prompting Category=Bias prompts + input-specific prompts + labeled images2026.030.1070.01—
ZSDEBIASBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts only2026.030.1860.03—
SEMbiBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.1930.044—
SEMbBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts only2026.030.1960.041—
SEMiBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias-agnostic + input-specific prompts2026.030.2010.037—
SEMiBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias-agnostic + input-specific prompts2026.030.2060.031—
ZSDEBIASBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts only2026.030.2170.049—
Original (gender)Backbone=ViT-B/16, Training Dataset=FairFace, Evaluation Attribute=gender2024.110.2180.088—
PRISMBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.2450.069—
SEMbBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts only2026.030.2580.079—
SEMbiBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.2590.079—
PRISMBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.2820.107—
ORTH-PROJBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts only2026.030.2880.111—
PRISM-MINIBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts only2026.030.2910.113—
BASE CLIPBackbone=ResNet-101, Zero-shot=true2026.030.3350.144—
BASE CLIPBackbone=ResNet-50, Zero-shot=true2026.030.3510.17—
Joint V-LBackbone=ViT-B/16, Zero-shot=true2026.070.3530.125—
ORTH-CALIBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.3570.141—
RG-TTABackbone=ViT-B/16, Zero-shot=true2026.070.3720.167—
ZSDEBIASBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts only2026.030.3830.046—
RG-TTABackbone=ViT-B/32, Zero-shot=true2026.070.3890.148—
ORTH-PROJBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts only2026.030.4090.213—
PRISM-MINIBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts only2026.030.4110.215—
BENDSEMbiBackbone=ResNet-101, Zero-shot=false, Prompting Category=Bias prompts + input-specific prompts + labeled images2026.030.4250.059—
ROBOSHOTBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias-agnostic + input-specific prompts2026.030.4450.299—
BENDSEMbiBackbone=ResNet-50, Zero-shot=false, Prompting Category=Bias prompts + input-specific prompts + labeled images2026.030.4550.067—
ORTH-CALIBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.470.278—
Ours (race)Backbone=ViT-B/16, Training Dataset=FairFace, Evaluation Attribute=race2024.110.4710.142—
ROBOSHOTBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias-agnostic + input-specific prompts2026.030.4940.338—
Joint V-LBackbone=ViT-B/32, Zero-shot=true2026.070.5030.149—
Biased-promptsBackbone=ViT-B/16, Zero-shot=true2026.070.5180.219—
Original (race)Backbone=ViT-B/16, Training Dataset=FairFace, Evaluation Attribute=race2024.110.5280.182—
Original CLIPBackbone=ViT-B/16, Zero-shot=true2026.070.5280.182—
CLIP-clipBackbone=ViT-B/16, Zero-shot=true2026.070.5440.161—
SEMiBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias-agnostic + input-specific prompts2026.030.5630.126—
SEMiBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias-agnostic + input-specific prompts2026.030.5660.111—
Original CLIPBackbone=ViT-B/32, Zero-shot=true2026.070.5680.165—
BENDVLMBackbone=ResNet-50, Zero-shot=false, Prompting Category=Bias prompts + input-specific prompts + labeled images2026.030.5810.15—
BENDVLMBackbone=ResNet-101, Zero-shot=false, Prompting Category=Bias prompts + input-specific prompts + labeled images2026.030.5830.125—
ZSDEBIASBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts only2026.030.5880.082—
PRISMBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.5940.152—
Biased-promptsBackbone=ViT-B/32, Zero-shot=true2026.070.5950.282—
SEMbiBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.6230.14—
SEMbiBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.6260.153—
PRISMBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.6320.157—
SEMbBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts only2026.030.6380.152—
Ours (age)Backbone=ViT-B/16, Training Dataset=FairFace, Evaluation Attribute=age2024.110.6490.425—
SEMbBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts only2026.030.6520.171—
Original (age)Backbone=ViT-B/16, Training Dataset=FairFace, Evaluation Attribute=age2024.110.6570.433—
ROBOSHOTBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias-agnostic + input-specific prompts2026.030.7060.215—
CLIP-clipBackbone=ViT-B/32, Zero-shot=true2026.070.7130.227—
BASE CLIPBackbone=ResNet-50, Zero-shot=true2026.030.7350.215—
BASE CLIPBackbone=ResNet-101, Zero-shot=true2026.030.7440.203—
ROBOSHOTBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias-agnostic + input-specific prompts2026.030.7980.222—
PRISM-MINIBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts only2026.030.8370.313—
ORTH-CALIBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.8420.297—
ORTH-PROJBackbone=ResNet-101, Zero-shot=true, Prompting Category=Bias prompts only2026.030.8430.322—
ORTH-CALIBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts + input-specific prompts2026.030.910.411—
PRISM-MINIBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts only2026.030.9830.454—
ORTH-PROJBackbone=ResNet-50, Zero-shot=true, Prompting Category=Bias prompts only2026.030.9960.464—