List your company
ResearchFormerly WizWand

Image Classification on FACET

70.8Macro F1Baseline CLIP (ViT-L/14)
46.8853.0959.365.51Mar 13, 2026
Updated 7mo ago

Evaluation results

MethodLinks
Baseline CLIP (ViT-L/14)Zero-shot=true, Backbone=ViT-L/142026.0370.88.949.8
OursZero-shot=true, Backbone=ViT-L/14, Attribute-annotated data=Not Required, Training=No, Debiased Modalities=I&T2026.0370.78.347.5
FairerCLIPZero-shot=true, Backbone=ViT-L/14, Attribute-annotated data=Required, Training=Yes, Debiased Modalities=I&T2026.0369.89.250.1
RoboShotZero-shot=true, Backbone=ViT-L/14, Attribute-annotated data=Not Required, Training=No, Debiased Modalities=I&T2026.0369.38.547.3
Orth-CaliZero-shot=true, Backbone=ViT-L/14, Attribute-annotated data=Not Required, Training=No, Debiased Modalities=T2026.0369.39.250.4
SFIDZero-shot=true, Backbone=ViT-L/14, Attribute-annotated data=Required, Training=Yes, Debiased Modalities=I&T2026.0369.29.349.8
PRISM-miniZero-shot=true, Backbone=ViT-L/14, Attribute-annotated data=Not Required, Training=Yes, Debiased Modalities=I&T2026.0369.28.649.2
PRISMZero-shot=true, Backbone=ViT-L/14, Attribute-annotated data=Not Required, Training=Yes, Debiased Modalities=I&T2026.03698.148.3
Orth-ProjZero-shot=true, Backbone=ViT-L/14, Attribute-annotated data=Not Required, Training=No, Debiased Modalities=T2026.0368.6950.2
Baseline BLIPProtocol=Zero-shot, Base Model=BLIP2026.0368.48.848
Debias_VLMProtocol=Zero-shot, Base Model=BLIP, Modality=Image & Text, Technique=Training-free2026.0368.47.344.7
FairerCLIPProtocol=Zero-shot, Base Model=BLIP, Modality=Image & Text, Technique=Training-based2026.03618.946.5
SFIDProtocol=Zero-shot, Base Model=BLIP, Modality=Image & Text, Technique=Training-based2026.0360.68.247.1
PRISMProtocol=Zero-shot, Base Model=BLIP, Modality=Image & Text, Technique=Training-based2026.0360.36.846
RoboShotProtocol=Zero-shot, Base Model=BLIP, Modality=Image & Text, Technique=Training-based2026.0360.37.644.4
PRISM-miniProtocol=Zero-shot, Base Model=BLIP, Modality=Image & Text, Technique=Training-free2026.03607.446.1
Orth-CaliProtocol=Zero-shot, Base Model=BLIP, Modality=Text, Technique=Training-free2026.0359.5846
CLIPBackbone=ResNet50, Zero-shot=true2026.0359.29.348.9
Debias_VLMBackbone=ResNet50, Modality=I&T, Zero-shot=true2026.0358.68.545.8
Orth-ProjProtocol=Zero-shot, Base Model=BLIP, Modality=Text, Technique=Training-free2026.0358.38.546.3
SFIDBackbone=ResNet50, Modality=I&T, Zero-shot=true2026.0350.89.447.2
FairerCLIPBackbone=ResNet50, Modality=I&T, Zero-shot=true2026.0350.78.947.2
RoboShotBackbone=ResNet50, Modality=I&T, Zero-shot=true2026.0350.7945.6
PRISMBackbone=ResNet50, Modality=I&T, Zero-shot=true2026.0350.58.447.6
Orth-CaliBackbone=ResNet50, Modality=T, Zero-shot=true2026.0349.68.947.6
PRISM-miniBackbone=ResNet50, Modality=I&T, Zero-shot=true2026.0349.28.946.6
Orth-ProjBackbone=ResNet50, Modality=T, Zero-shot=true2026.0347.88.847.9