Composed Image Retrieval on CIRR (val)
50.55Recall@1Candidate
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| CandidateYear=2024, Text Encoder=BLIP2026.04 | 50.55 | 81.75 | 89.78 | — | 80.04 | 91.9 | 80.9 | |
| CoVR-BLIPYear=2024, Text Encoder=BLIP2026.04 | 49.69 | 78.6 | 86.77 | — | 75.01 | 88.12 | 76.81 | |
| TEMAText Encoder=BLIP2026.04 | 49.15 | 82.18 | 88.81 | — | 78.17 | 90.32 | 80.18 | |
| CASEYear=2024, Text Encoder=BLIP2026.04 | 48 | 79.11 | 87.25 | — | 75.88 | 90.58 | 77.5 | |
| SPN-INzero-shot=true, training_domain=In-Domain2024.04 | 36.55 | 67.69 | — | — | 67.28 | — | — | |
| CombinerTraining dataset=CIRR2023.10 | 32.24 | 65.46 | 78.21 | 95.19 | — | — | — | |
| SPN-CCzero-shot=true, training_domain=Out-of-Domain, training_dataset=CC3M (50k images)2024.04 | 31.31 | 65.42 | — | — | 64.87 | — | — | |
| CIReVLMode=zero-shot2023.10 | 29.76 | 59.69 | 71.39 | 90.34 | — | — | — | |
| SEARLE-OTIzero-shot=true, training_domain=Out-of-Domain2024.04 | 24.87 | 52.31 | — | — | 53.8 | — | — | |
| SEARLE2024.12 | 24.2 | 52.5 | 66.3 | 88.8 | — | — | — | |
| SEARLE2024.12 | 24.2 | 52.5 | 66.3 | 88.8 | — | — | — | |
| PIC2WORDzero-shot=true, training_domain=Out-of-Domain2024.04 | 23.9 | 51.9 | — | — | — | — | — | |
| Pic2Word2024.12 | 23.9 | 51.7 | 65.3 | 87.8 | — | — | — | |
| Pic2Word2024.12 | 23.9 | 51.7 | 65.3 | 87.8 | — | — | — | |
| FREEDOMhyperparameter tuning on validation set=true2024.12 | 23.8 | 52.3 | 65.1 | 88.9 | — | — | — | |
| FREEDOMoptimized parameters=true, hyperparameter tuning=validation set of CIRR2024.12 | 23.8 | 52.3 | 65.1 | 88.9 | — | — | — | |
| FREEDOM2024.12 | 21 | 48.7 | 61.9 | 88.1 | — | — | — | |
| FREEDOM2024.12 | 21 | 48.7 | 61.9 | 88.1 | — | — | — | |
| CombinerTraining dataset=FashionIQ2023.10 | 19.88 | 48.05 | 61.11 | 85.51 | — | — | — | |
| CompoDiff2024.12 | 18.2 | 53.1 | 70.8 | 90.3 | — | — | — | |
| CompoDiff2024.12 | 18.2 | 53.1 | 70.8 | 90.3 | — | — | — | |
| CLIPzero-shot=true, training_domain=Out-of-Domain2024.04 | 12.65 | 38.41 | — | — | 34.29 | — | — |