Holistic Social Debiasing Assessment on Alignment and Bias Level Evaluation (ABLE)
0.845ABLE ScoreCLIP-clip
Evaluation Results
| Method | Links | |
|---|---|---|
| CLIP-clipBackbone=ViT-H/14, Biases=Gender2024.11 | 0.845 | |
| OursBackbone=ViT-L/14, Biases=Gender2024.11 | 0.8385 | |
| CLIP-clipBackbone=ViT-L/14, Biases=Gender2024.11 | 0.8368 | |
| Original CLIPBackbone=ViT-L/14, Biases=Gender2024.11 | 0.8361 | |
| OursBackbone=ViT-H/14, Biases=Gender2024.11 | 0.833 | |
| Original CLIPBackbone=ViT-H/14, Biases=Gender2024.11 | 0.827 | |
| Biased-promptsBackbone=ViT-H/14, Biases=Gender2024.11 | 0.8244 | |
| Biased-promptsBackbone=ViT-L/14, Biases=Gender2024.11 | 0.8048 | |
| OursBackbone=ViT-B/16, Biases=Gender2024.11 | 0.7936 | |
| CLIP-clipBackbone=ViT-B/16, Biases=Gender2024.11 | 0.7852 | |
| Original CLIPBackbone=ViT-B/16, Biases=Gender2024.11 | 0.7739 | |
| Original CLIPBackbone=ViT-B/32, Biases=Gender2024.11 | 0.756 | |
| OursBackbone=ViT-B/32, Biases=Gender2024.11 | 0.756 | |
| CLIP-clipBackbone=ViT-B/32, Biases=Gender2024.11 | 0.7379 | |
| Biased-promptsBackbone=ViT-B/16, Biases=Gender2024.11 | 0.7318 | |
| Biased-promptsBackbone=ViT-B/32, Biases=Gender2024.11 | 0.7274 | |
| Biased-promptsBackbone=ViT-H/14, Biases=Age2024.11 | 0.6973 | |
| CLIP-clipBackbone=ViT-H/14, Biases=Age2024.11 | 0.6969 | |
| OursBackbone=ViT-H/14, Biases=Age2024.11 | 0.6921 | |
| Biased-promptsBackbone=ViT-L/14, Biases=Age2024.11 | 0.6911 | |
| Original CLIPBackbone=ViT-H/14, Biases=Age2024.11 | 0.683 | |
| CLIP-clipBackbone=ViT-B/16, Biases=Age2024.11 | 0.677 | |
| Original CLIPBackbone=ViT-B/16, Biases=Age2024.11 | 0.6696 | |
| OursBackbone=ViT-B/16, Biases=Age2024.11 | 0.6686 | |
| Original CLIPBackbone=ViT-B/32, Biases=Age2024.11 | 0.6477 | |
| OursBackbone=ViT-B/32, Biases=Age2024.11 | 0.6469 | |
| CLIP-clipBackbone=ViT-B/32, Biases=Age2024.11 | 0.6434 | |
| OursBackbone=ViT-L/14, Biases=Age2024.11 | 0.6433 | |
| Original CLIPBackbone=ViT-L/14, Biases=Age2024.11 | 0.6287 | |
| CLIP-clipBackbone=ViT-L/14, Biases=Age2024.11 | 0.6108 | |
| Biased-promptsBackbone=ViT-B/16, Biases=Age2024.11 | 0.6083 | |
| Biased-promptsBackbone=ViT-B/32, Biases=Age2024.11 | 0.6019 |