Compositional Evaluation on Winoground (test)
74Text ScoreYUKINO
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| YUKINOImage Encoder=ViT-B-32, Pre-training Dataset=LAION2B2024.12 | 74 | 46.25 | 42.75 | 84.5 | 71.75 | |
| YUKINO-OTIImage Encoder=ViT-B-32, Pre-training Dataset=LAION2B2024.12 | 66.75 | 42.5 | 37.5 | 81 | 69.75 | |
| YUKINOImage Encoder=ViT-B-16, Pre-training Dataset=DataComp2024.12 | 66.25 | 36.5 | 31.5 | 79.63 | 66.88 | |
| YUKINO-OTIImage Encoder=ViT-B-16, Pre-training Dataset=DataComp2024.12 | 51.25 | 26 | 22 | 68.5 | 60.38 | |
| YUKINOImage Encoder=ViT-L-14, Pre-training Dataset=WIT2024.12 | 45.5 | 29.5 | 22.5 | 64.13 | 60.88 | |
| CLIPImage Encoder=ViT-B-32, Pre-training Dataset=LAION2B2024.12 | 34.75 | 11 | 7.5 | 62.38 | 54.13 | |
| YUKINO-OTIImage Encoder=ViT-L-14, Pre-training Dataset=WIT2024.12 | 34.5 | 17.5 | 13.5 | 54.75 | 52.5 | |
| CLIPImage Encoder=ViT-L-14, Pre-training Dataset=WIT2024.12 | 28.75 | 11 | 8.5 | 60.13 | 55 | |
| CLIPImage Encoder=ViT-B-16, Pre-training Dataset=DataComp2024.12 | 26.25 | 8 | 6 | 56.75 | 53.13 | |
| Structure-CLIPImage Encoder=ViT-L-14, Pre-training Dataset=WIT2024.12 | 25.25 | 16.25 | 10.5 | 57.25 | 55.38 | |
| Structure-CLIPImage Encoder=ViT-B-32, Pre-training Dataset=LAION2B2024.12 | 22.5 | 14 | 8.25 | 57.63 | 55 | |
| Neg-CLIPImage Encoder=ViT-L-14, Pre-training Dataset=WIT2024.12 | 22.5 | 12 | 8 | 58 | 54.63 | |
| Neg-CLIPImage Encoder=ViT-B-16, Pre-training Dataset=DataComp2024.12 | 20.75 | 10 | 6 | 55 | 53.75 | |
| Neg-CLIPImage Encoder=ViT-B-32, Pre-training Dataset=LAION2B2024.12 | 20.5 | 12.25 | 6.5 | 57.13 | 54.5 | |
| Structure-CLIPImage Encoder=ViT-B-16, Pre-training Dataset=DataComp2024.12 | 19.25 | 10.5 | 6 | 55.63 | 53.88 |