Commonsense Reasoning on WinoGAViL
65.2Accuracy (5-6)ReasonSigLIP2
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ReasonSigLIP2Scale=ViT So400m (428M), Resolution=384/14, Data=+42M2026.06 | 65.2 | 60.1 | 64 | |
| SigLIP2Scale=ViT Giant Opt (1B), Resolution=384/16, Data=10.0B2026.06 | 64.4 | 61.5 | 63.7 | |
| Long-CLIPScale=ViT Large (307M), Resolution=224/14, Data=0.4B2026.06 | 63.7 | 56.5 | 62 | |
| SigLIP2Scale=ViT Large (307M), Resolution=384/16, Data=10.0B2026.06 | 63.2 | 58.4 | 62.1 | |
| SigLIPScale=ViT So400m (428M), Resolution=384/14, Data=10.0B2026.06 | 63 | 57.7 | 61.7 | |
| ReasonCLIPScale=ViT Large (307M), Resolution=224/14, Data=+42M2026.06 | 62.5 | 56.6 | 61.1 | |
| ReasonCLIPScale=ViT Large (307M), Resolution=336/14, Data=+42M2026.06 | 62.3 | 54.6 | 60.2 | |
| SigLIP2Scale=ViT So400m (428M), Resolution=384/14, Data=10.0B2026.06 | 62.1 | 56.8 | 60.8 | |
| ReasonSigLIP2Scale=ViT Giant Opt (1B), Resolution=384/16, Data=+42M2026.06 | 62.1 | 60.1 | 61.6 | |
| MetaCLIPScale=ViT Large (307M), Resolution=224/14, Data=2.5B2026.06 | 59.6 | 53.6 | 58.2 | |
| ReasonSigLIPScale=ViT So400m (428M), Resolution=384/14, Data=+42M2026.06 | 58.7 | 50.9 | 56.8 | |
| MetaCLIPScale=ViT Base (86M), Resolution=224/32, Data=0.4B2026.06 | 58.3 | 51 | 56.5 | |
| ReasonCLIPScale=ViT Base (86M), Resolution=224/32, Data=+42M2026.06 | 57.8 | 49.6 | 55.8 | |
| Eva-CLIP-02Scale=ViT Large (307M), Resolution=336/14, Data=2.0B2026.06 | 56.8 | 50.5 | 55.3 | |
| Eva-CLIP-02Scale=ViT Large (307M), Resolution=224/14, Data=2.0B2026.06 | 56.5 | 50.5 | 55 | |
| DataCompScale=ViT Base (86M), Resolution=224/32, Data=1.4B2026.06 | 55.6 | 45.8 | 53.3 | |
| ViTaminScale=ViT Large (307M), Resolution=336/16, Data=1.0B2026.06 | 54.4 | 46.8 | 53.7 | |
| OpenCLIPScale=ViT Large (307M), Resolution=224/14, Data=2.0B2026.06 | 53.8 | 44 | 51.5 | |
| CLIPScale=ViT Base (86M), Resolution=224/32, Data=0.4B2026.06 | 53.5 | 41.5 | 50.6 | |
| CLIPScale=ViT Large (307M), Resolution=224/14, Data=0.4B2026.06 | 53.3 | 41.1 | 50.4 | |
| OpenCLIPScale=ViT Base (86M), Resolution=224/32, Data=0.4B2026.06 | 53.2 | 42.6 | 50.6 | |
| CLIPScale=ViT Large (307M), Resolution=336/14, Data=0.4B2026.06 | 53 | 41.4 | 50.2 |