Composed Image Retrieval on FashionIQ 1.0 (test)
45.7R@10IP-CIR
Evaluation Results
| Method | Links | |
|---|---|---|
| IP-CIRBackbone=CLIP-G, # Params=43.8B+, Zero-shot evaluation=true2024.12 | 45.7 | |
| MagicLens-L*Backbone=CoCa-L, # Params=613M, Zero-shot evaluation=true2024.12 | 38 | |
| CompoDiffBackbone=CLIP-L, # Params=568M, Zero-shot evaluation=true2024.12 | 36 | |
| MMRet-MLLMBackbone=LLaVA-1.6, # Params=7.57B, Zero-shot evaluation=true2024.12 | 35.6 | |
| PLIBackbone=CLIP-L, # Params=428M, Zero-shot evaluation=true2024.12 | 35.4 | |
| MagicLens-B*Backbone=CoCa-B, # Params=267M, Zero-shot evaluation=true2024.12 | 35.2 | |
| MMRet-LargeBackbone=CLIP-L, # Params=428M, Zero-shot evaluation=true2024.12 | 34.6 | |
| LDREBackbone=CLIP-G, # Params=10.3B+, Zero-shot evaluation=true2024.12 | 32.5 | |
| CIREVLBackbone=CLIP-G, # Params=14.6B+, Zero-shot evaluation=true2024.12 | 32.2 | |
| MMRet-BaseBackbone=CLIP-B, # Params=149M, Zero-shot evaluation=true2024.12 | 31.9 | |
| E5-VBackbone=LLaVA-1.6, # Params=8.35B, Zero-shot evaluation=true2024.12 | 31.8 | |
| MagicLens-LBackbone=CLIP-L, # Params=465M, Zero-shot evaluation=true2024.12 | 30.7 | |
| CIREVLBackbone=CLIP-L, # Params=12.5B+, Zero-shot evaluation=true2024.12 | 28.6 | |
| LDREBackbone=CLIP-L, # Params=8.2B+, Zero-shot evaluation=true2024.12 | 28.5 | |
| CIREVLBackbone=CLIP-B, # Params=12.3B+, Zero-shot evaluation=true2024.12 | 28.3 | |
| MagicLens-BBackbone=CLIP-B, # Params=166M, Zero-shot evaluation=true2024.12 | 26.3 | |
| SEARLEBackbone=CLIP-L, # Params=442M, Zero-shot evaluation=true2024.12 | 25.6 | |
| LDREBackbone=CLIP-B, # Params=7.9B+, Zero-shot evaluation=true2024.12 | 24.8 | |
| Pic2WordBackbone=CLIP-L, # Params=429M, Zero-shot evaluation=true2024.12 | 24.7 | |
| SEARLEBackbone=CLIP-B, # Params=165M, Zero-shot evaluation=true2024.12 | 22.9 |