# Composed Image Retrieval on PinPoint (test)

Source: [Composed Image Retrieval on PinPoint (test)](<https://www.sota2.com/research/sota/composed-image-retrieval-on-pinpoint-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-06T07:40:44.173Z

Evaluation of Composed Image Retrieval performance using the test split of the PinPoint dataset, measured using mAP@K, Negative Recall, and Linguistic Sensitivity Range metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Composed Image Retrieval |
| Dataset (including any stated split) | PinPoint (test) |
| Metric | mAP@10 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 19 of 19 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [mAP@10](<https://www.sota2.com/research/sota/composed-image-retrieval-on-pinpoint-test.md?metric=mAP%4010>): Higher is better; unit: PERCENT.

- [mAP@10 (No Negatives)](<https://www.sota2.com/research/sota/composed-image-retrieval-on-pinpoint-test.md?metric=mAP%4010%20(No%20Negatives)>): Higher is better; unit: PERCENT.

- [Relative mAP Decline (%)](<https://www.sota2.com/research/sota/composed-image-retrieval-on-pinpoint-test.md?metric=Relative%20mAP%20Decline%20(%25)>): Lower is better; unit: PERCENT.

- [Negative Recall@10](<https://www.sota2.com/research/sota/composed-image-retrieval-on-pinpoint-test.md?metric=Negative%20Recall%4010>): Higher is better; unit: PERCENT.

- [Linguistic Sensitivity Range](<https://www.sota2.com/research/sota/composed-image-retrieval-on-pinpoint-test.md?metric=Linguistic%20Sensitivity%20Range>): Higher is better; unit: PERCENT.

## Recorded results

| Method | mAP@10 | Result date | Report paper |
| --- | --- | --- | --- |
| MMRet-MLLM-S1 + Reranking | 29 | Not recorded | 69aa5f622d603e6de3e416b3 |
| GPT-5-Text – Premerge + Reranking | 27.2 | Not recorded | 69aa5f622d603e6de3e416b3 |
| GPT-5-Text – Premerge | 26.6 | Not recorded | 69aa5f622d603e6de3e416b3 |
| GPT-5-Text – Postmerge | 23.6 | Not recorded | 69aa5f622d603e6de3e416b3 |
| MMRet-CLIP-L + Reranking | 23.6 | Not recorded | 69aa5f622d603e6de3e416b3 |
| MagicLens-CLIP-L + Reranking | 23.1 | Not recorded | 69aa5f622d603e6de3e416b3 |
| MMRet-MLLM-S1 | 22.4 | Not recorded | 69aa5f622d603e6de3e416b3 |
| MMRet-MLLM-S2 | 20.3 | Not recorded | 69aa5f622d603e6de3e416b3 |
| MMRet-CLIP-L | 17.8 | Not recorded | 69aa5f622d603e6de3e416b3 |
| MagicLens-CLIP-L | 15.5 | Not recorded | 69aa5f622d603e6de3e416b3 |
| MMRet-CLIP-B | 15.3 | Not recorded | 69aa5f622d603e6de3e416b3 |
| MagicLens-CLIP-B | 11.1 | Not recorded | 69aa5f622d603e6de3e416b3 |
| LinCIR | 11 | Not recorded | 69aa5f622d603e6de3e416b3 |
| Meta CLIP 2 – Combined + Reranking | 8.7 | Not recorded | 69aa5f622d603e6de3e416b3 |
| Pic2Word | 4.6 | Not recorded | 69aa5f622d603e6de3e416b3 |
| Meta CLIP 2 – Combined | 4.4 | Not recorded | 69aa5f622d603e6de3e416b3 |
| Meta CLIP 2 – SLERP | 4.3 | Not recorded | 69aa5f622d603e6de3e416b3 |
| Meta CLIP 2 – Text Only | 3.1 | Not recorded | 69aa5f622d603e6de3e416b3 |
| Meta CLIP 2 – Image Only | 1.7 | Not recorded | 69aa5f622d603e6de3e416b3 |

### MMRet-MLLM-S1 + Reranking

mAP@10: 29. Result ID: 69aa84fb6dbb7075b953fc20.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

Recorded evaluation configuration: {"Method Family":"CIR Family","Backbone":"MLLM-S1","Reranking":"true"}. This record does not assert independent reproduction.

### GPT-5-Text – Premerge + Reranking

mAP@10: 27.2. Result ID: 69aa84fb6dbb7075b953fc1f.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

Recorded evaluation configuration: {"Method Family":"Text Generation","Fusion Strategy":"Premerge","Reranking":"true"}. This record does not assert independent reproduction.

### GPT-5-Text – Premerge

mAP@10: 26.6. Result ID: 69aa84fb6dbb7075b953fc1b.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

Recorded evaluation configuration: {"Method Family":"Text Generation","Fusion Strategy":"Premerge"}. This record does not assert independent reproduction.

### GPT-5-Text – Postmerge

mAP@10: 23.6. Result ID: 69aa84fb6dbb7075b953fc1a.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

Recorded evaluation configuration: {"Method Family":"Text Generation","Fusion Strategy":"Postmerge"}. This record does not assert independent reproduction.

### MMRet-CLIP-L + Reranking

mAP@10: 23.6. Result ID: 69aa84fb6dbb7075b953fc1d.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

Recorded evaluation configuration: {"Method Family":"CIR Family","Backbone":"CLIP-L","Reranking":"true"}. This record does not assert independent reproduction.

### MagicLens-CLIP-L + Reranking

mAP@10: 23.1. Result ID: 69aa84fb6dbb7075b953fc1e.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73e01e209131cea5e9da.md>)

[Implementation](<https://open-vision-language.github.io/MagicLens/>)

Recorded evaluation configuration: {"Method Family":"CIR Family","Backbone":"CLIP-L","Reranking":"true"}. This record does not assert independent reproduction.

### MMRet-MLLM-S1

mAP@10: 22.4. Result ID: 69aa84fb6dbb7075b953fc19.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

Recorded evaluation configuration: {"Method Family":"CIR Family","Backbone":"MLLM-S1"}. This record does not assert independent reproduction.

### MMRet-MLLM-S2

mAP@10: 20.3. Result ID: 69aa84fb6dbb7075b953fc18.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

Recorded evaluation configuration: {"Method Family":"CIR Family","Backbone":"MLLM-S2"}. This record does not assert independent reproduction.

### MMRet-CLIP-L

mAP@10: 17.8. Result ID: 69aa84fb6dbb7075b953fc17.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

Recorded evaluation configuration: {"Method Family":"CIR Family","Backbone":"CLIP-L"}. This record does not assert independent reproduction.

### MagicLens-CLIP-L

mAP@10: 15.5. Result ID: 69aa84fb6dbb7075b953fc16.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73e01e209131cea5e9da.md>)

[Implementation](<https://open-vision-language.github.io/MagicLens/>)

Recorded evaluation configuration: {"Method Family":"CIR Family","Backbone":"CLIP-L"}. This record does not assert independent reproduction.

### MMRet-CLIP-B

mAP@10: 15.3. Result ID: 69aa84fb6dbb7075b953fc15.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

Recorded evaluation configuration: {"Method Family":"CIR Family","Backbone":"CLIP-B"}. This record does not assert independent reproduction.

### MagicLens-CLIP-B

mAP@10: 11.1. Result ID: 69aa84fb6dbb7075b953fc14.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73e01e209131cea5e9da.md>)

[Implementation](<https://open-vision-language.github.io/MagicLens/>)

Recorded evaluation configuration: {"Method Family":"CIR Family","Backbone":"CLIP-B"}. This record does not assert independent reproduction.

### LinCIR

mAP@10: 11. Result ID: 69aa84fb6dbb7075b953fc13.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

Recorded evaluation configuration: {"Method Family":"CIR Family"}. This record does not assert independent reproduction.

### Meta CLIP 2 – Combined + Reranking

mAP@10: 8.7. Result ID: 69aa84fb6dbb7075b953fc1c.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a571e209131cea829d6.md>)

Recorded evaluation configuration: {"Method Family":"CLIP Family","Fusion Strategy":"Combined","Reranking":"true"}. This record does not assert independent reproduction.

### Pic2Word

mAP@10: 4.6. Result ID: 69aa84fb6dbb7075b953fc12.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f591e209131cea452c7.md>)

[Implementation](<https://github.com/google-research/composed_image_retrieval>)

Recorded evaluation configuration: {"Method Family":"CIR Family"}. This record does not assert independent reproduction.

### Meta CLIP 2 – Combined

mAP@10: 4.4. Result ID: 69aa84fb6dbb7075b953fc11.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a571e209131cea829d6.md>)

Recorded evaluation configuration: {"Method Family":"CLIP Family","Fusion Strategy":"Combined"}. This record does not assert independent reproduction.

### Meta CLIP 2 – SLERP

mAP@10: 4.3. Result ID: 69aa84fb6dbb7075b953fc10.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a571e209131cea829d6.md>)

Recorded evaluation configuration: {"Method Family":"CLIP Family","Fusion Strategy":"SLERP"}. This record does not assert independent reproduction.

### Meta CLIP 2 – Text Only

mAP@10: 3.1. Result ID: 69aa84fb6dbb7075b953fc0f.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a571e209131cea829d6.md>)

Recorded evaluation configuration: {"Method Family":"CLIP Family","Input Modality":"Text Only"}. This record does not assert independent reproduction.

### Meta CLIP 2 – Image Only

mAP@10: 1.7. Result ID: 69aa84fb6dbb7075b953fc0e.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f622d603e6de3e416b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a571e209131cea829d6.md>)

Recorded evaluation configuration: {"Method Family":"CLIP Family","Input Modality":"Image Only"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
