Text-to-image retrieval on COCO 2017
93.9Recall@5Baseline BLIP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Baseline BLIP2026.03 | 93.9 | 97.2 | 15.1 | — | |
| Debias_VLMTraining modality=I&T, Model state=Frozen, Debiasing labels=No2026.03 | 92.2 | 96.7 | 12 | — | |
| Orth-ProjTraining modality=T, Model state=Frozen, Debiasing labels=No2026.03 | 90.8 | 92.8 | 13.5 | — | |
| SFIDTraining modality=I&T, Model state=Fine-tuned, Debiasing labels=Yes2026.03 | 90.6 | 95.9 | 12.5 | — | |
| PromptArrayTraining modality=I&T, Model state=Fine-tuned, Debiasing labels=Yes2026.03 | 90.4 | 96 | 12.9 | — | |
| CLIP-clipTraining modality=I&T, Model state=Frozen, Debiasing labels=Yes2026.03 | 90.3 | 94.5 | 11.2 | — | |
| Orth-CaliTraining modality=T, Model state=Frozen, Debiasing labels=No2026.03 | 90.3 | 94.1 | 13.7 | — | |
| FairerCLIPTraining modality=I&T, Model state=Fine-tuned, Debiasing labels=Yes2026.03 | 90 | 94.7 | 13.3 | — | |
| Baseline CLIPBackbone=ViT-L/142026.03 | 83.8 | 90.1 | 13.4 | — | |
| Debias_VLMAttribute-annotated data requirement=false, Training requirement=false, Debiased modality=I&T2026.03 | 81.1 | 89 | 10.1 | — | |
| SFIDAttribute-annotated data requirement=true, Training requirement=true, Debiased modality=I&T2026.03 | 77.4 | 86.6 | 13.2 | — | |
| PromptArrayAttribute-annotated data requirement=true, Training requirement=false, Debiased modality=I&T2026.03 | 77.2 | 86.7 | 12.8 | — | |
| FairerCLIPAttribute-annotated data requirement=true, Training requirement=true, Debiased modality=I&T2026.03 | 76.8 | 85.4 | 10.2 | — | |
| CLIP-clipAttribute-annotated data requirement=true, Training requirement=false, Debiased modality=I&T2026.03 | 76.1 | 85.2 | 9.9 | — | |
| Orth-CaliAttribute-annotated data requirement=false, Training requirement=false, Debiased modality=T2026.03 | 75.2 | 84.9 | 13.8 | — | |
| Orth-ProjAttribute-annotated data requirement=false, Training requirement=false, Debiased modality=T2026.03 | 74.5 | 83.6 | 13.6 | — | |
| CoOpFoundation Model=CLIP-L/14-3362026.05 | 71.63 | 79.14 | — | 44.74 | |
| Baseline CLIPBackbone=ResNet502026.03 | 71.4 | 81.8 | 13.3 | — | |
| MaPLeFoundation Model=CLIP-L/142026.05 | 71.26 | 77.26 | — | 44.21 | |
| FreqAdapterFoundation Model=CLIP-L/14-3362026.05 | 70.92 | 80.02 | — | 45.23 | |
| FreqAdapterFoundation Model=CLIP-B/162026.05 | 70.58 | 80.04 | — | 43.3 | |
| CLIP-AdapterFoundation Model=CLIP-L/14-3362026.05 | 70.2 | 79.58 | — | 44.62 | |
| MaPLeFoundation Model=CLIP-L/14-3362026.05 | 70.16 | 79.62 | — | 44.45 | |
| FreqAdapterFoundation Model=CLIP-L/142026.05 | 70.04 | 79.55 | — | 44.18 | |
| CLIP-AdapterFoundation Model=CLIP-L/142026.05 | 69.92 | 79.28 | — | 43.18 | |
| CoOpFoundation Model=CLIP-L/142026.05 | 69.84 | 78.29 | — | 43.26 | |
| MMAFoundation Model=CLIP-L/14-3362026.05 | 69.46 | 78.89 | — | 43.55 | |
| CLIP-AdapterFoundation Model=CLIP-B/162026.05 | 68.57 | 78.32 | — | 41.6 | |
| MMAFoundation Model=CLIP-L/142026.05 | 68.32 | 78.22 | — | 42.58 | |
| Debias_VLMBackbone=ResNet50, Modality=I&T2026.03 | 68.3 | 78.4 | 10.1 | — | |
| LoR-VPFoundation Model=CLIP-L/14-3362026.05 | 68.17 | 77.46 | — | 42.35 | |
| SFIDBackbone=ResNet50, Modality=I&T2026.03 | 66.6 | 76.3 | 12.7 | — | |
| PromptArrayBackbone=ResNet50, Modality=I&T2026.03 | 66.5 | 76.5 | 12.2 | — | |
| FairerCLIPBackbone=ResNet50, Modality=I&T2026.03 | 65.8 | 74.8 | 11.8 | — | |
| CLIP-clipBackbone=ResNet50, Modality=I&T2026.03 | 65.6 | 74.9 | 10 | — | |
| MMAFoundation Model=CLIP-B/162026.05 | 65.53 | 76.09 | — | 39.41 | |
| Orth-CaliBackbone=ResNet50, Modality=T2026.03 | 64.7 | 74.6 | 11 | — | |
| Orth-ProjBackbone=ResNet50, Modality=T2026.03 | 64.2 | 72.5 | 11.2 | — | |
| CoOpFoundation Model=CLIP-B/162026.05 | 63.19 | 75.27 | — | 38.53 | |
| MaPLeFoundation Model=CLIP-B/162026.05 | 62.13 | 73.21 | — | 37.26 | |
| CLIP-L/14-336Foundation Model=CLIP-L/14-3362026.05 | 60.7 | 70.66 | — | 36.08 | |
| CLIP-L/14Foundation Model=CLIP-L/142026.05 | 59.9 | 70.26 | — | 35.51 | |
| CLIP-B/16Foundation Model=CLIP-B/162026.05 | 57.6 | 68.04 | — | 32.65 |