List your company
ResearchFormerly WizWand

Holistic Social Debiasing Assessment on Alignment and Bias Level Evaluation (ABLE)

0.845ABLE ScoreCLIP-clip
0.5921760.6578130.723450.789087Nov 19, 2024
Updated 8mo ago

Evaluation results

MethodLinks
CLIP-clipBackbone=ViT-H/14, Biases=Gender2024.110.845
OursBackbone=ViT-L/14, Biases=Gender2024.110.8385
CLIP-clipBackbone=ViT-L/14, Biases=Gender2024.110.8368
Original CLIPBackbone=ViT-L/14, Biases=Gender2024.110.8361
OursBackbone=ViT-H/14, Biases=Gender2024.110.833
Original CLIPBackbone=ViT-H/14, Biases=Gender2024.110.827
Biased-promptsBackbone=ViT-H/14, Biases=Gender2024.110.8244
Biased-promptsBackbone=ViT-L/14, Biases=Gender2024.110.8048
OursBackbone=ViT-B/16, Biases=Gender2024.110.7936
CLIP-clipBackbone=ViT-B/16, Biases=Gender2024.110.7852
Original CLIPBackbone=ViT-B/16, Biases=Gender2024.110.7739
Original CLIPBackbone=ViT-B/32, Biases=Gender2024.110.756
OursBackbone=ViT-B/32, Biases=Gender2024.110.756
CLIP-clipBackbone=ViT-B/32, Biases=Gender2024.110.7379
Biased-promptsBackbone=ViT-B/16, Biases=Gender2024.110.7318
Biased-promptsBackbone=ViT-B/32, Biases=Gender2024.110.7274
Biased-promptsBackbone=ViT-H/14, Biases=Age2024.110.6973
CLIP-clipBackbone=ViT-H/14, Biases=Age2024.110.6969
OursBackbone=ViT-H/14, Biases=Age2024.110.6921
Biased-promptsBackbone=ViT-L/14, Biases=Age2024.110.6911
Original CLIPBackbone=ViT-H/14, Biases=Age2024.110.683
CLIP-clipBackbone=ViT-B/16, Biases=Age2024.110.677
Original CLIPBackbone=ViT-B/16, Biases=Age2024.110.6696
OursBackbone=ViT-B/16, Biases=Age2024.110.6686
Original CLIPBackbone=ViT-B/32, Biases=Age2024.110.6477
OursBackbone=ViT-B/32, Biases=Age2024.110.6469
CLIP-clipBackbone=ViT-B/32, Biases=Age2024.110.6434
OursBackbone=ViT-L/14, Biases=Age2024.110.6433
Original CLIPBackbone=ViT-L/14, Biases=Age2024.110.6287
CLIP-clipBackbone=ViT-L/14, Biases=Age2024.110.6108
Biased-promptsBackbone=ViT-B/16, Biases=Age2024.110.6083
Biased-promptsBackbone=ViT-B/32, Biases=Age2024.110.6019