# Composed Image Retrieval on Multi-Target CIRR (test)

Source: [Composed Image Retrieval on Multi-Target CIRR (test)](<https://www.sota2.com/research/sota/composed-image-retrieval-on-multi-target-cirr-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:10:03.576Z

Evaluation of Composed Image Retrieval performance using the test split of the Multi-Target CIRR dataset, measured using mAP@K metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Composed Image Retrieval |
| Dataset (including any stated split) | Multi-Target CIRR (test) |
| Metric | mAP@5 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [mAP@5](<https://www.sota2.com/research/sota/composed-image-retrieval-on-multi-target-cirr-test.md?metric=mAP%405>): Higher is better; unit: PERCENT.

- [mAP@10](<https://www.sota2.com/research/sota/composed-image-retrieval-on-multi-target-cirr-test.md?metric=mAP%4010>): Higher is better; unit: PERCENT.

- [mAP@25](<https://www.sota2.com/research/sota/composed-image-retrieval-on-multi-target-cirr-test.md?metric=mAP%4025>): Higher is better; unit: PERCENT.

- [mAP@50](<https://www.sota2.com/research/sota/composed-image-retrieval-on-multi-target-cirr-test.md?metric=mAP%4050>): Higher is better; unit: PERCENT.

## Recorded results

| Method | mAP@5 | Result date | Report paper |
| --- | --- | --- | --- |
| SEARLE + SoFT | 62.29 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| CIReVL + SoFT | 61.12 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| CIReVL + SoFT | 60.82 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| SEARLE + SoFT | 60.22 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| CIReVL + SoFT | 60.21 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| CIReVL + SoFT | 59.53 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| SEARLE + SoFT | 59.13 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| CIReVL + SoFT | 58.75 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| CIReVL + SoFT | 58.31 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| CIReVL | 58.04 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| SEARLE + SoFT | 55.35 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| SEARLE | 52.1 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| SEARLE + SoFT | 52.02 | Not recorded | 694cc50b53fdd5c36173a8e4 |
| SEARLE + SoFT | 50.35 | Not recorded | 694cc50b53fdd5c36173a8e4 |

### SEARLE + SoFT

mAP@5: 62.29. Result ID: 6998b5735698665ec4186313.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"0.3"}. This record does not assert independent reproduction.

### CIReVL + SoFT

mAP@5: 61.12. Result ID: 6998b5735698665ec4186310.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"1.0"}. This record does not assert independent reproduction.

### CIReVL + SoFT

mAP@5: 60.82. Result ID: 6998b5735698665ec418630f.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"0.9"}. This record does not assert independent reproduction.

### SEARLE + SoFT

mAP@5: 60.22. Result ID: 6998b5735698665ec4186312.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"0.1"}. This record does not assert independent reproduction.

### CIReVL + SoFT

mAP@5: 60.21. Result ID: 6998b5735698665ec418630e.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"0.7"}. This record does not assert independent reproduction.

### CIReVL + SoFT

mAP@5: 59.53. Result ID: 6998b5735698665ec418630d.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"0.5"}. This record does not assert independent reproduction.

### SEARLE + SoFT

mAP@5: 59.13. Result ID: 6998b5735698665ec4186314.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"0.5"}. This record does not assert independent reproduction.

### CIReVL + SoFT

mAP@5: 58.75. Result ID: 6998b5735698665ec418630c.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"0.3"}. This record does not assert independent reproduction.

### CIReVL + SoFT

mAP@5: 58.31. Result ID: 6998b5735698665ec418630b.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"0.1"}. This record does not assert independent reproduction.

### CIReVL

mAP@5: 58.04. Result ID: 6998b5735698665ec418630a.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d7d.md>)

[Implementation](<https://github.com/ExplainableML/Vision_by_Language>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14"}. This record does not assert independent reproduction.

### SEARLE + SoFT

mAP@5: 55.35. Result ID: 6998b5735698665ec4186315.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"0.7"}. This record does not assert independent reproduction.

### SEARLE

mAP@5: 52.1. Result ID: 6998b5735698665ec4186311.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70581e209131cea4a6dd.md>)

[Implementation](<https://github.com/miccunifi/SEARLE>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14"}. This record does not assert independent reproduction.

### SEARLE + SoFT

mAP@5: 52.02. Result ID: 6998b5735698665ec4186316.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"0.9"}. This record does not assert independent reproduction.

### SEARLE + SoFT

mAP@5: 50.35. Result ID: 6998b5735698665ec4186317.

[Reporting paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc50b53fdd5c36173a8e4.md>)

Recorded evaluation configuration: {"Backbone":"ViT-L/14","Interpolation weight λ":"1.0"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
