Fine-grained Retrieval on Winoground (test)
40Text Agreement (%)Sugar
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Sugar2024.11 | 40 | 36.3 | 27 | |
| UNITERSize=large2024.11 | 38 | 14 | 10.5 | |
| VinVL2024.11 | 37.8 | 17.8 | 14.5 | |
| VILLASize=large2024.11 | 37 | 13.25 | 10 | |
| BLIP2024.11 | 34.8 | 14 | 9.3 | |
| FLAVAObjective=ITM2024.11 | 32.3 | 20.5 | 14.3 | |
| CLIPBackbone=ViT-B/322024.11 | 30.8 | 10.5 | 8 | |
| FLAVAObjective=contrastive2024.11 | 25.3 | 13.5 | 9 | |
| LXMERT2024.11 | 23.8 | 7.3 | 4.8 | |
| ViLBERTSize=base2024.11 | 23.8 | 7.3 | 4.8 | |
| ViLTBackbone=ViT-B/322024.11 | 19.3 | 7 | 4 | |
| VisualBERTSize=base2024.11 | 15.5 | 2.5 | 1.5 |