Single-conditional retrieval on Clevr 4
88.6mAP (Shape)CLAY
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| CLAYBase VLM=SigLIP-B2026.04 | 88.6 | — | — | — | — | 73.2 | 26.1 | 22.7 | |
| InstructBLIP2026.04 | 83.4 | — | — | — | — | 27.4 | 22.8 | 17.9 | |
| SigLIP-BBase VLM=SigLIP-B2026.04 | 77.7 | — | — | — | — | 20 | 18.6 | 13 | |
| CLAYBase VLM=CLIP-B2026.04 | 72.1 | — | — | — | — | 67.9 | 22.2 | 21.8 | |
| CLIP-BBase VLM=CLIP-B2026.04 | 61.7 | — | — | — | — | 19.9 | 18.1 | 13.9 | |
| GeneCIS2026.04 | 47.9 | — | — | — | — | 16.6 | 16 | 11.5 | |
| MagicLens2026.04 | 45.1 | — | — | — | — | 21.2 | 12.9 | 13.7 | |
| SEARLE2026.04 | 43 | — | — | — | — | 20.7 | 13.8 | 13 | |
| CLAYBackbone=CLIP-L2026.04 | — | 79.5 | 64.8 | 24.9 | 19.9 | — | — | — | |
| CLAYBackbone=SigLIP-L2026.04 | — | 93.1 | 67.6 | 25.6 | 25.8 | — | — | — | |
| CLIP-LBackbone=CLIP-L2026.04 | — | 71.1 | 17.1 | 18.7 | 13.5 | — | — | — | |
| SigLIP-LBackbone=SigLIP-L2026.04 | — | 83.6 | 18.7 | 19.4 | 13 | — | — | — |