Compositional Image-Text Matching on SugarCrepe
88.7Replacement ScoreCREM 7B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CREM 7BZero-shot=true, Parameters=7B2026.02 | 88.7 | 74 | 91.7 | |
| CapArch=B/162023.06 | 88.21 | 84 | 98.94 | |
| CREM 2BZero-shot=true, Parameters=2B2026.02 | 87.9 | 66.1 | 91.5 | |
| CapPaArch=B/162023.06 | 87.67 | 83.11 | 99.13 | |
| OpenCLIPArch=G/142023.06 | 86.5 | 68.56 | 88.36 | |
| VLM2VecZero-shot=true2026.02 | 85.8 | 66.3 | 86.5 | |
| NegCLIPArch=B/322023.06 | 85.36 | 75.33 | 87.29 | |
| CLIP*Arch=B/162023.06 | 81.95 | 63.22 | 81.91 | |
| UniMEZero-shot=true2026.02 | 80.5 | 65.5 | 82.2 |