# Multimodal Search on MM Search

Source: [Multimodal Search on MM Search](<https://www.sota2.com/research/sota/multimodal-search-on-mm-search>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:04:00.911Z

Evaluation of model performance on the MM Search dataset for Multimodal Search capabilities, measured by Score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multimodal Search |
| Dataset (including any stated split) | MM Search |
| Metric | Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Score](<https://www.sota2.com/research/sota/multimodal-search-on-mm-search.md?metric=Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Score | Result date | Report paper |
| --- | --- | --- | --- |
| Gemini-3-Pro | 73 | Not recorded | 6993f6959ebc499c97409f1e |
| REDSearcher-MM-RL | 72.9 | Not recorded | 6993f6959ebc499c97409f1e |
| REDSearcher-MM-SFT | 70.3 | Not recorded | 6993f6959ebc499c97409f1e |
| Seed1.8 | 69.7 | Not recorded | 6993f6959ebc499c97409f1e |
| Vision-DeepResearch | 69.6 | Not recorded | 6993f6959ebc499c97409f1e |
| Gemini-2.5-Pro | 69 | Not recorded | 6993f6959ebc499c97409f1e |
| Gemini-2.5-Flash | 64 | Not recorded | 6993f6959ebc499c97409f1e |
| GPT-5 | 63.7 | Not recorded | 6993f6959ebc499c97409f1e |
| DeepEyesV2 | 63.7 | Not recorded | 6993f6959ebc499c97409f1e |
| Qwen3-VL Thinking | 63.3 | Not recorded | 6993f6959ebc499c97409f1e |
| Qwen3-VL Thinking | 59.7 | Not recorded | 6993f6959ebc499c97409f1e |
| WebWatcher | 55.3 | Not recorded | 6993f6959ebc499c97409f1e |
| MMSearch-R1 | 53.8 | Not recorded | 6993f6959ebc499c97409f1e |
| Qwen2.5-VL | 29.2 | Not recorded | 6993f6959ebc499c97409f1e |

### Gemini-3-Pro

Score: 73. Result ID: 699a93db5698665ec41ec5f7.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

Recorded evaluation configuration: {"Params":"-","Evaluation Tools":"Same as ours"}. This record does not assert independent reproduction.

### REDSearcher-MM-RL

Score: 72.9. Result ID: 699a93db5698665ec41ec600.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Implementation](<https://github.com/RedSearchAgent/REDSearcher>)

Recorded evaluation configuration: {"Params":"30B"}. This record does not assert independent reproduction.

### REDSearcher-MM-SFT

Score: 70.3. Result ID: 699a93db5698665ec41ec5ff.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Implementation](<https://github.com/RedSearchAgent/REDSearcher>)

Recorded evaluation configuration: {"Params":"30B"}. This record does not assert independent reproduction.

### Seed1.8

Score: 69.7. Result ID: 699a93db5698665ec41ec5f5.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

Recorded evaluation configuration: {"Params":"-","Evaluation Tools":"Same as ours"}. This record does not assert independent reproduction.

### Vision-DeepResearch

Score: 69.6. Result ID: 699a93db5698665ec41ec5fe.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/697c3b79a8b01e76cc8da7d0.md>)

[Implementation](<https://github.com/Osilly/Vision-DeepResearch>)

Recorded evaluation configuration: {"Params":"30B"}. This record does not assert independent reproduction.

### Gemini-2.5-Pro

Score: 69. Result ID: 699a93db5698665ec41ec5f4.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c311e209131cea8cef5.md>)

Recorded evaluation configuration: {"Params":"-"}. This record does not assert independent reproduction.

### Gemini-2.5-Flash

Score: 64. Result ID: 699a93db5698665ec41ec5f3.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c311e209131cea8cef5.md>)

Recorded evaluation configuration: {"Params":"-"}. This record does not assert independent reproduction.

### GPT-5

Score: 63.7. Result ID: 699a93db5698665ec41ec5f6.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695f39f053fdd5c361743ecb.md>)

Recorded evaluation configuration: {"Params":"-"}. This record does not assert independent reproduction.

### DeepEyesV2

Score: 63.7. Result ID: 699a93db5698665ec41ec5fd.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/691171652828b7cc6937d492.md>)

[Implementation](<https://github.com/Visual-Agent/DeepEyes>)

Recorded evaluation configuration: {"Params":"7B"}. This record does not assert independent reproduction.

### Qwen3-VL Thinking

Score: 63.3. Result ID: 699a93db5698665ec41ec5fa.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"Params":"235B"}. This record does not assert independent reproduction.

### Qwen3-VL Thinking

Score: 59.7. Result ID: 699a93db5698665ec41ec5f9.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"Params":"30B"}. This record does not assert independent reproduction.

### WebWatcher

Score: 55.3. Result ID: 699a93db5698665ec41ec5fc.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b0d1e209131cea8667a.md>)

Recorded evaluation configuration: {"Params":"32B"}. This record does not assert independent reproduction.

### MMSearch-R1

Score: 53.8. Result ID: 699a93db5698665ec41ec5fb.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79a01e209131cea7e86c.md>)

Recorded evaluation configuration: {"Params":"7B"}. This record does not assert independent reproduction.

### Qwen2.5-VL

Score: 29.2. Result ID: 699a93db5698665ec41ec5f8.

[Reporting paper](<https://www.sota2.com/research/paper/6993f6959ebc499c97409f1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Params":"72B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
