Composed Image Retrieval on Fashion-IQ (test)
0.6326Average Recall@10COMBINER
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| COMBINERMethod Category=VLP Model-Based2026.06 | 0.6326 | 0.5796 | 0.7908 | 0.6364 | 0.8184 | 0.6818 | 0.8587 | 0.8227 | — | — | |
| OFFSETModel Category=VLP Model-Based2025.07 | 0.6259 | 0.5786 | 0.7913 | 0.6281 | 0.8155 | 0.6711 | 0.8587 | 0.8218 | — | — | |
| DQU-CIRModel Category=VLP Model-Based2025.07 | 0.6197 | 0.5763 | 0.7856 | 0.6214 | 0.8038 | 0.6615 | 0.8573 | 0.8156 | — | — | |
| DQU-CIRMethod Category=VLP Model-Based2026.06 | 0.6197 | 0.5763 | 0.7856 | 0.6214 | 0.8038 | 0.6615 | 0.8573 | 0.8156 | — | — | |
| MELT2026.03 | 0.592 | — | — | — | — | — | — | 0.7986 | — | — | |
| LIMN+Model Category=VLP Model-Based2025.07 | 0.5743 | 0.5211 | 0.7521 | 0.5751 | 0.7792 | 0.6267 | 0.8266 | 0.786 | — | — | |
| LIMN+Method Category=VLP Model-Based2026.06 | 0.5743 | 0.5211 | 0.7521 | 0.5751 | 0.7792 | 0.6267 | 0.8266 | 0.786 | — | — | |
| SPRC + SPNBackbone=BLIP-22024.04 | 0.5637 | 0.5057 | 0.7412 | 0.577 | 0.7527 | 0.6084 | 0.7996 | 0.7645 | 0.6641 | — | |
| ENCODERModel Category=VLP Model-Based2025.07 | 0.5613 | 0.5151 | 0.7695 | 0.5486 | 0.7493 | 0.6201 | 0.8088 | 0.7759 | — | — | |
| ENCODER2026.03 | 0.5613 | — | — | — | — | — | — | 0.7759 | — | — | |
| ENCODERMethod Category=VLP Model-Based2026.06 | 0.5613 | 0.5151 | 0.7695 | 0.5486 | 0.7493 | 0.6201 | 0.8088 | 0.7759 | — | — | |
| LIMNModel Category=VLP Model-Based2025.07 | 0.5591 | 0.5072 | 0.7452 | 0.5608 | 0.7709 | 0.6094 | 0.8185 | 0.7782 | — | — | |
| LIMNMethod Category=VLP Model-Based2026.06 | 0.5591 | 0.5072 | 0.7452 | 0.5608 | 0.7709 | 0.6094 | 0.8185 | 0.7782 | — | — | |
| SPRCBackbone=BLIP-22024.04 | 0.5492 | 0.4918 | 0.7243 | 0.5564 | 0.7389 | 0.5935 | 0.7858 | 0.7497 | 0.6485 | — | |
| SPRCModel Category=VLP Model-Based2025.07 | 0.5472 | 0.4918 | 0.7243 | 0.5564 | 0.7389 | 0.5935 | 0.7858 | 0.7497 | — | — | |
| SPRC2026.03 | 0.5472 | — | — | — | — | — | — | 0.7497 | — | — | |
| SPRCMethod Category=VLP Model-Based2026.06 | 0.5472 | 0.4918 | 0.7243 | 0.5564 | 0.7389 | 0.5935 | 0.7858 | 0.7497 | — | — | |
| DIPNECMethod Category=VLP Model-Based2026.06 | 0.54 | 0.469 | 0.7129 | 0.5692 | 0.7777 | 0.5818 | 0.8088 | 0.7664 | — | — | |
| PAIR2026.03 | 0.5276 | — | — | — | — | — | — | 0.7451 | — | — | |
| QuRe2026.03 | 0.526 | — | — | — | — | — | — | 0.7348 | — | — | |
| MEDIAN2026.03 | 0.5239 | — | — | — | — | — | — | 0.743 | — | — | |
| FashionERNModel Category=VLP Model-Based2025.07 | 0.5229 | 0.5032 | 0.7129 | 0.5015 | 0.7036 | 0.564 | 0.7721 | 0.7295 | — | — | |
| TG-CIR2026.03 | 0.5132 | — | — | — | — | — | — | 0.7309 | — | — | |
| TG-CIRMethod Category=VLP Model-Based2026.06 | 0.5132 | 0.4522 | 0.6966 | 0.526 | 0.7252 | 0.5614 | 0.771 | 0.7309 | — | — | |
| CandidateModel Category=VLP Model-Based2025.07 | 0.5117 | 0.4814 | 0.7134 | 0.5015 | 0.7125 | 0.5523 | 0.768 | 0.7313 | — | — | |
| CandidateMethod Category=VLP Model-Based2026.06 | 0.5117 | 0.4814 | 0.7134 | 0.5015 | 0.7125 | 0.5523 | 0.768 | 0.7313 | — | — | |
| CoVR-BLIP-2Mode=Finetuning, Year=2024, Pretraining Data=WV-CC-CoVIR2023.08 | 0.4996 | 0.4653 | 0.696 | 0.5123 | 0.7064 | 0.5214 | 0.7327 | 0.7117 | — | — | |
| CoVR-2Model Category=VLP Model-Based2025.07 | 0.4996 | 0.4653 | 0.696 | 0.5123 | 0.7064 | 0.5214 | 0.7327 | 0.7117 | — | — | |
| CoVR-2Method Category=VLP Model-Based2026.06 | 0.4996 | 0.4653 | 0.696 | 0.5123 | 0.7064 | 0.5214 | 0.7327 | — | — | — | |
| CoVR-BLIP-2Mode=Finetuning, Year=2024, Pretraining Data=CC-CoIR2023.08 | 0.499 | 0.4649 | 0.6931 | 0.5167 | 0.7049 | 0.5153 | 0.7307 | 0.7096 | — | — | |
| CoVR-BLIP-2Mode=Finetuning, Year=20242023.08 | 0.4886 | 0.4525 | 0.6886 | 0.4995 | 0.6995 | 0.5137 | 0.7256 | 0.7046 | — | — | |
| CASEMode=Finetuning, Year=2024, Pretraining Data=LaSCo2023.08 | 0.4879 | 0.4744 | 0.6936 | 0.4848 | 0.7023 | 0.5018 | 0.7224 | 0.7068 | — | — | |
| CoVR-BLIPMode=Finetuning, Year=2024, Pretraining Data=WebVid-CoVR2023.08 | 0.4853 | 0.4455 | 0.6903 | 0.4843 | 0.6742 | 0.526 | 0.7431 | 0.7025 | — | — | |
| COVR-BLIP2026.03 | 0.4853 | — | — | — | — | — | — | 0.7025 | — | — | |
| BLIP4CIR + SPNBackbone=BLIP2024.04 | 0.4698 | 0.4452 | 0.6713 | 0.4568 | 0.6796 | 0.5074 | 0.7379 | 0.6963 | 0.583 | — | |
| FAME-ViLModel Category=VLP Model-Based2025.07 | 0.4684 | 0.4219 | 0.6738 | 0.4764 | 0.6879 | 0.5069 | 0.7307 | 0.6975 | — | — | |
| FAME-ViLMethod Category=VLP Model-Based2026.06 | 0.4684 | 0.4219 | 0.6738 | 0.4764 | 0.6879 | 0.5069 | 0.7307 | 0.6975 | — | — | |
| CaLaModel Category=VLP Model-Based2025.07 | 0.4669 | 0.4238 | 0.6608 | 0.4676 | 0.6816 | 0.5093 | 0.7342 | 0.6922 | — | — | |
| Prog. Lrn.Model Category=VLP Model-Based2025.07 | 0.4638 | 0.3818 | 0.645 | 0.4863 | 0.7154 | 0.5232 | 0.769 | 0.7098 | — | — | |
| Prog. Lrn.Method Category=VLP Model-Based2026.06 | 0.4638 | 0.3818 | 0.645 | 0.4863 | 0.7154 | 0.5232 | 0.769 | 0.7098 | — | — | |
| BLIP4CIRBackbone=BLIP2024.04 | 0.4631 | 0.4422 | 0.6708 | 0.45 | 0.6668 | 0.4972 | 0.7302 | 0.6893 | 0.5762 | — | |
| LinCIR + IP-CIRBackbone=ViT-G/142024.11 | 0.4574 | 0.3902 | 0.6103 | 0.4804 | 0.6668 | 0.5018 | 0.7114 | 0.6628 | — | — | |
| LinCIRBackbone=ViT-G, Supervision=Zero-shot2023.12 | 0.4511 | 0.3808 | 0.6088 | 0.4676 | 0.6511 | 0.5048 | 0.7109 | 0.6569 | — | — | |
| LinCIRBackbone=ViT-G/142024.11 | 0.4511 | 0.3808 | 0.6088 | 0.4676 | 0.6511 | 0.5048 | 0.7109 | 0.6569 | — | — | |
| LinCIR (ViT-G)Mode=Zero Shot, Year=20242023.08 | 0.4511 | 0.3808 | 0.6088 | 0.4676 | 0.6511 | 0.5048 | 0.7109 | 0.6569 | — | — | |
| LinCIRBackbone=ViT G/14, Additional pre-training step=true2024.09 | 0.4511 | 0.3808 | 0.6088 | 0.4676 | 0.6511 | 0.5048 | 0.7109 | 0.6569 | — | — | |
| MMF2026.03 | 0.4485 | — | — | — | — | — | — | 0.6752 | — | — | |
| COPE2026.03 | 0.445 | — | — | — | — | — | — | 0.686 | — | — | |
| CLIP4CIR + SPNBackbone=CLIP2024.04 | 0.4448 | 0.3882 | 0.6292 | 0.4583 | 0.6644 | 0.488 | 0.7129 | 0.6688 | 0.5568 | — | |
| SADNModel Category=VLP Model-Based2025.07 | 0.4391 | 0.4001 | 0.651 | 0.4367 | 0.6605 | 0.4804 | 0.7093 | 0.6736 | — | — | |
| SADNMethod Category=VLP Model-Based2026.06 | 0.4391 | 0.4001 | 0.651 | 0.4367 | 0.6605 | 0.4804 | 0.7093 | 0.6736 | — | — | |
| CLIP4CIRBackbone=CLIP2024.04 | 0.4252 | 0.3818 | 0.6267 | 0.4401 | 0.6457 | 0.4539 | 0.6956 | 0.656 | 0.5406 | — | |
| TG-CIR + SPNBackbone=CLIP2024.04 | 0.4143 | 0.3684 | 0.6083 | 0.4185 | 0.6389 | 0.4559 | 0.6879 | 0.645 | 0.5297 | — | |
| TG-CIRBackbone=CLIP2024.04 | 0.3981 | 0.3555 | 0.5944 | 0.4024 | 0.6237 | 0.4365 | 0.6736 | 0.6306 | 0.5144 | — | |
| CompoDiffMode=Finetuning, Year=2023, Pretraining Data=ST18M+LAION2B2023.08 | 0.3981 | 0.3839 | 0.5103 | 0.4168 | 0.5602 | 0.457 | 0.5732 | 0.519 | — | — | |
| IUDCModel Category=VLP Model-Based2025.07 | 0.3976 | 0.3522 | 0.619 | 0.4186 | 0.6352 | 0.4219 | 0.6923 | 0.6488 | — | — | |
| IUDC2026.03 | 0.3976 | — | — | — | — | — | — | 0.6488 | — | — | |
| IUDCMethod Category=VLP Model-Based2026.06 | 0.3976 | 0.3522 | 0.619 | 0.4186 | 0.6352 | 0.4219 | 0.6923 | 0.6488 | — | — | |
| AFCEMethod Category=VLP Model-Based2026.06 | 0.3929 | 0.3398 | 0.5996 | 0.4015 | 0.6276 | 0.4375 | 0.607 | 0.6347 | — | — | |
| PL4CIRBackbone=CLIP2024.04 | 0.3902 | 0.336 | 0.589 | 0.3945 | 0.6178 | 0.4396 | 0.6833 | 0.63 | 0.5101 | — | |
| CompoDiffMode=Zero Shot, Year=2023, Pretraining Data=ST18M+LAION2B2023.08 | 0.3902 | 0.3778 | 0.491 | 0.4131 | 0.5517 | 0.4426 | 0.5641 | 0.5171 | — | — | |
| CompoDiffBackbone=ViT G/14, Additional pre-training step=true2024.09 | 0.3902 | 0.3778 | 0.491 | 0.4131 | 0.5517 | 0.4426 | 0.5641 | 0.5171 | — | — | |
| SSN2026.03 | 0.3892 | — | — | — | — | — | — | 0.6389 | — | — | |
| Ours (m=0)Training Setting=Zero-shot, Interaction Turns=m=02026.05 | 0.385 | — | — | — | — | — | — | 0.602 | — | — | |
| CombinerSupervision=supervised2023.12 | 0.3832 | 0.3381 | 0.594 | 0.3999 | 0.6045 | 0.4141 | 0.6537 | 0.6174 | — | — | |
| CoVR-BLIP-2Mode=Zero Shot, Year=2024, Pretraining Data=WV-CC-CoVIR2023.08 | 0.3815 | 0.3426 | 0.5622 | 0.4122 | 0.5932 | 0.3896 | 0.5977 | 0.5844 | — | — | |
| SyncMaskModel Category=VLP Model-Based2025.07 | 0.3813 | 0.3376 | 0.6123 | 0.3582 | 0.6212 | 0.4482 | 0.7206 | 0.6514 | — | — | |
| SyncMaskMethod Category=VLP Model-Based2026.06 | 0.3813 | 0.3376 | 0.6123 | 0.3582 | 0.6212 | 0.4482 | 0.7206 | 0.6514 | — | — | |
| OSrCIRTraining Setting=Zero-shot, Interaction Turns=m=02026.05 | 0.371 | — | — | — | — | — | — | 0.59 | — | — | |
| WeiMoCIRBackbone=ViT G/14, Additional pre-training step=false2024.09 | 0.3703 | 0.3099 | 0.5245 | 0.3773 | 0.5618 | 0.4238 | 0.6323 | 0.5729 | — | — | |
| CoVR-BLIP-2Mode=Zero Shot, Year=2024, Pretraining Data=CC-CoIR2023.08 | 0.3649 | 0.3317 | 0.5513 | 0.3881 | 0.5824 | 0.3748 | 0.5849 | 0.5729 | — | — | |
| FashionSAP2023.04 | 0.3626 | 0.3371 | 0.6043 | 0.3317 | 0.6133 | 0.4191 | 0.7093 | 0.6423 | — | — | |
| LinCIRBackbone=ViT-H, Supervision=Zero-shot2023.12 | 0.3626 | 0.298 | 0.5211 | 0.369 | 0.5775 | 0.4207 | 0.6252 | 0.5746 | — | — | |
| LinCIRBackbone=ViT H/14, Additional pre-training step=true2024.09 | 0.3626 | 0.298 | 0.5211 | 0.369 | 0.5775 | 0.4207 | 0.6252 | 0.5746 | — | — | |
| FashionSAPModel Category=VLP Model-Based2025.07 | 0.3626 | 0.3371 | 0.6043 | 0.4191 | 0.7093 | 0.3317 | 0.6133 | 0.6423 | — | — | |
| CompoDiffBackbone=ViT L/14, Additional pre-training step=true2024.09 | 0.3602 | 0.3224 | 0.4627 | 0.3769 | 0.4908 | 0.3812 | 0.5057 | 0.4864 | — | — | |
| Multi-grained Uncertainty RegularizationVisual Backbone=ResNet-50x42022.11 | 0.3575 | 0.3261 | 0.6134 | 0.3323 | 0.6255 | 0.414 | 0.7251 | 0.6547 | — | — | |
| MGURModel Category=Traditional Model-Based2025.07 | 0.3575 | 0.3261 | 0.6134 | 0.3323 | 0.6255 | 0.414 | 0.7251 | 0.6547 | — | — | |
| MGURMethod Category=Traditional Model-Based2026.06 | 0.3575 | 0.3261 | 0.6134 | 0.3323 | 0.6255 | 0.414 | 0.7251 | 0.6547 | — | — | |
| CLIP4CirVisual Backbone=ResNet-50x42022.11 | 0.3539 | 0.3163 | 0.5667 | 0.3636 | 0.58 | 0.3819 | 0.6242 | 0.5903 | — | — | |
| LF-CLIPMode=Finetuning, Year=20222023.08 | 0.3539 | 0.3163 | 0.5667 | 0.3636 | 0.58 | 0.3819 | 0.6242 | 0.5903 | — | — | |
| CombinerMode=Finetuning, Year=20222023.08 | 0.3539 | 0.3163 | 0.5667 | 0.3636 | 0.58 | 0.3819 | 0.6242 | 0.5903 | — | — | |
| LF-CLIPMethod Category=VLP Model-Based2026.06 | 0.3539 | 0.3163 | 0.5667 | 0.3636 | 0.58 | 0.3819 | 0.6242 | 0.5903 | — | — | |
| Pic2WordBackbone=ViT-H, Supervision=Zero-shot2023.12 | 0.3503 | 0.2801 | 0.5151 | 0.369 | 0.5599 | 0.4018 | 0.6201 | 0.565 | — | — | |
| Pic2WordBackbone=ViT H/14, Additional pre-training step=true2024.09 | 0.3503 | 0.2801 | 0.5151 | 0.369 | 0.5599 | 0.4018 | 0.6201 | 0.565 | — | — | |
| WeiMoCIRBackbone=ViT H/14, Additional pre-training step=false2024.09 | 0.3501 | 0.2876 | 0.4898 | 0.3656 | 0.5358 | 0.3972 | 0.5987 | 0.5414 | — | — | |
| SEARLEBackbone=ViT-G, Supervision=Zero-shot2023.12 | 0.3481 | 0.2816 | 0.5032 | 0.3646 | 0.5535 | 0.3983 | 0.6145 | 0.5571 | — | — | |
| SEARLEBackbone=ViT-G/142024.11 | 0.3481 | 0.2816 | 0.5032 | 0.3646 | 0.5535 | 0.3983 | 0.6145 | 0.5571 | — | — | |
| SEARLEBackbone=ViT G/14, Additional pre-training step=true2024.09 | 0.3481 | 0.2816 | 0.5032 | 0.3646 | 0.5535 | 0.3983 | 0.6145 | 0.5571 | — | — | |
| SEARLEBackbone=ViT-H, Supervision=Zero-shot2023.12 | 0.3457 | 0.2846 | 0.5107 | 0.3646 | 0.5545 | 0.3881 | 0.6089 | 0.558 | — | — | |
| SEARLEBackbone=ViT H/14, Additional pre-training step=true2024.09 | 0.3457 | 0.2846 | 0.5107 | 0.3646 | 0.5545 | 0.3881 | 0.6089 | 0.558 | — | — | |
| Fashion VLP2023.04 | 0.3427 | 0.3242 | 0.6029 | 0.3189 | 0.5844 | 0.3851 | 0.6879 | 0.6251 | — | — | |
| FashionVLPMode=Finetuning, Year=20222023.08 | 0.3427 | 0.3242 | 0.6029 | 0.3189 | 0.5844 | 0.3851 | 0.6879 | 0.6251 | — | — | |
| Multi-grained Uncertainty RegularizationVisual Backbone=ResNet-50x22022.11 | 0.3425 | 0.3125 | 0.5835 | 0.3169 | 0.6065 | 0.3982 | 0.7107 | 0.6336 | — | — | |
| CRNMethod Category=Traditional Model-Based2026.06 | 0.3356 | 0.3267 | 0.593 | 0.3027 | 0.5697 | 0.3774 | 0.6594 | 0.6074 | — | — | |
| Multi-grained Uncertainty RegularizationVisual Backbone=ResNet-502022.11 | 0.3317 | 0.306 | 0.5746 | 0.3154 | 0.5829 | 0.3737 | 0.6841 | 0.6139 | — | — | |
| LDREBackbone=ViT G/14, Additional pre-training step=false2024.09 | 0.3249 | 0.2611 | 0.5112 | 0.3594 | 0.5858 | 0.3542 | 0.5667 | 0.5546 | — | — | |
| CompoDiffTraining Setting=Zero-shot, Interaction Turns=m=02026.05 | 0.324 | — | — | — | — | — | — | 0.579 | — | — | |
| CIReVLMode=Zero Shot, Year=20242023.08 | 0.3219 | 0.2707 | 0.4953 | 0.3371 | 0.5142 | 0.358 | 0.5614 | 0.5236 | — | — | |
| CIREVLBackbone=ViT G/14, Additional pre-training step=false2024.09 | 0.3219 | 0.2707 | 0.4953 | 0.3371 | 0.5142 | 0.358 | 0.5614 | 0.5236 | — | — |