Medical Image Classification on Harvard-FairVLMed Linear Probing (test)
69.04Overall F1 ScoreFairEnc
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FairEncAttribute=Race, Protocol=Linear Probing2026.05 | 69.04 | 66.37 | 71.23 | 68.49 | 69.04 | — | — | — | — | — | — | — | 68.49 | |
| FairEncAttribute=Gender, Protocol=Linear Probing2026.05 | 69.04 | 65.68 | — | — | — | 66.72 | 71.86 | — | — | — | — | — | 66.72 | |
| FairEncAttribute=Ethnicity, Protocol=Linear Probing2026.05 | 69.04 | 66.85 | — | — | — | — | — | 69.17 | 65.88 | — | — | — | 65.88 | |
| FairEncAttribute=Language, Protocol=Linear Probing2026.05 | 69.04 | 62.31 | — | — | — | — | — | — | — | 69.55 | 71.3 | 60.67 | 60.67 | |
| FairMoEAttribute=Gender, Protocol=Linear Probing2026.05 | 68.95 | 66.3 | — | — | — | 67.15 | 71.15 | — | — | — | — | — | 67.15 | |
| FairMoEAttribute=Race, Protocol=Linear Probing2026.05 | 68.75 | 65.07 | 70.21 | 65.16 | 69.38 | — | — | — | — | — | — | — | 65.16 | |
| Robust FairCLIPAttribute=Race, Protocol=Linear Probing2026.05 | 68.39 | 64.97 | 70.72 | 66.54 | 68.64 | — | — | — | — | — | — | — | 66.54 | |
| FairCLIPAttribute=Ethnicity, Protocol=Linear Probing2026.05 | 68.07 | 65.14 | — | — | — | — | — | 68.17 | 65.07 | — | — | — | 65.07 | |
| FairCLIPAttribute=Gender, Protocol=Linear Probing2026.05 | 68.06 | 65.06 | — | — | — | 65.97 | 70.59 | — | — | — | — | — | 65.97 | |
| FairCLIPAttribute=Language, Protocol=Linear Probing2026.05 | 67.86 | 64.42 | — | — | — | — | — | — | — | 67.88 | 67.44 | 69.5 | 67.44 | |
| CLIPAttribute=Race, Protocol=Linear Probing2026.05 | 67.82 | 64.75 | 70.3 | 66.24 | 67.98 | — | — | — | — | — | — | — | 66.24 | |
| CLIPAttribute=Gender, Protocol=Linear Probing2026.05 | 67.82 | 64.94 | — | — | — | 65.82 | 70.25 | — | — | — | — | — | 65.82 | |
| CLIPAttribute=Ethnicity, Protocol=Linear Probing2026.05 | 67.82 | 64.39 | — | — | — | — | — | 68.02 | 62.66 | — | — | — | 62.66 | |
| CLIPAttribute=Language, Protocol=Linear Probing2026.05 | 67.82 | 61.62 | — | — | — | — | — | — | — | 68.08 | 71.68 | 63.7 | 63.7 | |
| FairCLIPAttribute=Race, Protocol=Linear Probing2026.05 | 67.04 | 63.4 | 70.15 | 65.47 | 67.11 | — | — | — | — | — | — | — | 65.47 | |
| Robust FairCLIPAttribute=Language, Protocol=Linear Probing2026.05 | 67.01 | 59.87 | — | — | — | — | — | — | — | 67.11 | 73.73 | 65.21 | 65.21 | |
| Robust FairCLIPAttribute=Gender, Protocol=Linear Probing2026.05 | 66.29 | 63.73 | — | — | — | 64.45 | 68.51 | — | — | — | — | — | 64.45 | |
| JTT CLIPAttribute=Race, Protocol=Linear Probing2026.05 | 65.3 | 63.28 | 66.34 | 66.04 | 65.17 | — | — | — | — | — | — | — | 65.17 | |
| JTT CLIPAttribute=Gender, Protocol=Linear Probing2026.05 | 65.3 | 62.12 | — | — | — | 62.99 | 68.12 | — | — | — | — | — | 62.99 | |
| JTT CLIPAttribute=Ethnicity, Protocol=Linear Probing2026.05 | 65.3 | 60.84 | — | — | — | — | — | 65.58 | 58.1 | — | — | — | 58.1 | |
| JTT CLIPAttribute=Language, Protocol=Linear Probing2026.05 | 65.3 | 58.13 | — | — | — | — | — | — | — | 65.67 | 65.4 | 60.69 | 60.69 | |
| FairMoEAttribute=Ethnicity, Protocol=Linear Probing2026.05 | 63.56 | 58.51 | — | — | — | — | — | 63.85 | 55.44 | — | — | — | 55.44 | |
| Robust FairCLIPAttribute=Ethnicity, Protocol=Linear Probing2026.05 | 63.33 | 57.64 | — | — | — | — | — | 63.68 | 53.68 | — | — | — | 53.68 | |
| FairMoEAttribute=Language, Protocol=Linear Probing2026.05 | 63.06 | 54.79 | — | — | — | — | — | — | — | 63.17 | 71.55 | 60.38 | 60.38 |