# Multimodal Search on MMSearch (Acc, SR img, SR txt) Source: [Multimodal Search on MMSearch (Acc, SR img, SR txt)]() Collection index: [llms.txt]() Data updated: 2026-04-15T10:17:28.945Z Evaluation of model performance on the MMSearch dataset for Multimodal Search, reporting Accuracy and Success Rates (SR img/txt). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Multimodal Search | | Dataset (including any stated split) | MMSearch | | Metric | Success Rate | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 27 of 27 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Success Rate](): Higher is better; unit: PERCENT. - [Accuracy](): Higher is better; unit: PERCENT. - [Success Rate (Image Retrieval)](): Higher is better; unit: PERCENT. - [Success Rate (Text Retrieval)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Success Rate | Result date | Report paper | | --- | --- | --- | --- | | Seed-1.8 | 73.2 | Not recorded | 69df1bc57d0172140ec7bb9b | | REDSearcher-MM-30B | 72.9 | Not recorded | 69df1bc57d0172140ec7bb9b | | Kimi-K2.5 | 72.3 | Not recorded | 69df1bc57d0172140ec7bb9b | | LMM-Searcher-30B | 72.3 | Not recorded | 69df1bc57d0172140ec7bb9b | | GPT-5 | 72.2 | Not recorded | 69df1bc57d0172140ec7bb9b | | LMM-Searcher-30B | 71 | Not recorded | 69df1bc57d0172140ec7bb9b | | Vision-DeepResearch-30B | 69.6 | Not recorded | 69df1bc57d0172140ec7bb9b | | Gemini-2.5-Pro | 66.3 | Not recorded | 69df1bc57d0172140ec7bb9b | | Qwen3-VL-30B-A3B-Thinking | 62 | Not recorded | 69df1bc57d0172140ec7bb9b | | Gemini-2.5-Flash | 59.8 | Not recorded | 69df1bc57d0172140ec7bb9b | | Webwatcher-32B | 55.3 | Not recorded | 69df1bc57d0172140ec7bb9b | | MMSearch-R1-7B | 53.8 | Not recorded | 69df1bc57d0172140ec7bb9b | | Webwatcher-7B | 49.1 | Not recorded | 69df1bc57d0172140ec7bb9b | | Kimi-K2.5 | 47 | Not recorded | 69df1bc57d0172140ec7bb9b | | Gemini-2.5-Pro | 39.8 | Not recorded | 69df1bc57d0172140ec7bb9b | | GPT-5 | 33.3 | Not recorded | 69df1bc57d0172140ec7bb9b | | Seed-1.8 | 31 | Not recorded | 69df1bc57d0172140ec7bb9b | | Gemini-2.5-Flash | 30.4 | Not recorded | 69df1bc57d0172140ec7bb9b | | Qwen3-VL-30B-A3B-Thinking | 17.7 | Not recorded | 69df1bc57d0172140ec7bb9b | ### Seed-1.8 Success Rate: 73.2. Result ID: 69df659e47f34ce924c8b7dd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Method Category":"Agentic Search"}. This record does not assert independent reproduction. ### REDSearcher-MM-30B Success Rate: 72.9. Result ID: 69df659e47f34ce924c8b7e6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Method Category":"Multimodal Search Agent"}. This record does not assert independent reproduction. ### Kimi-K2.5 Success Rate: 72.3. Result ID: 69df659e47f34ce924c8b7de. [Reporting paper]() Recorded evaluation configuration: {"Method Category":"Agentic Search"}. This record does not assert independent reproduction. ### LMM-Searcher-30B Success Rate: 72.3. Result ID: 69df659e47f34ce924c8b7e8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Method Category":"Multimodal Search Agent","Evaluation Turns":"100","Context Management":"Enabled"}. This record does not assert independent reproduction. ### GPT-5 Success Rate: 72.2. Result ID: 69df659e47f34ce924c8b7dc. [Reporting paper]() Recorded evaluation configuration: {"Method Category":"Agentic Search"}. This record does not assert independent reproduction. ### LMM-Searcher-30B Success Rate: 71. Result ID: 69df659e47f34ce924c8b7e7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Method Category":"Multimodal Search Agent"}. This record does not assert independent reproduction. ### Vision-DeepResearch-30B Success Rate: 69.6. Result ID: 69df659e47f34ce924c8b7e5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Method Category":"Multimodal Search Agent"}. This record does not assert independent reproduction. ### Gemini-2.5-Pro Success Rate: 66.3. Result ID: 69df659e47f34ce924c8b7df. [Reporting paper]() Recorded evaluation configuration: {"Method Category":"Agentic Search"}. This record does not assert independent reproduction. ### Qwen3-VL-30B-A3B-Thinking Success Rate: 62. Result ID: 69df659e47f34ce924c8b7e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Method Category":"Agentic Search"}. This record does not assert independent reproduction. ### Gemini-2.5-Flash Success Rate: 59.8. Result ID: 69df659e47f34ce924c8b7e0. [Reporting paper]() Recorded evaluation configuration: {"Method Category":"Agentic Search"}. This record does not assert independent reproduction. ### Webwatcher-32B Success Rate: 55.3. Result ID: 69df659e47f34ce924c8b7e4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Method Category":"Multimodal Search Agent"}. This record does not assert independent reproduction. ### MMSearch-R1-7B Success Rate: 53.8. Result ID: 69df659e47f34ce924c8b7e2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Method Category":"Multimodal Search Agent"}. This record does not assert independent reproduction. ### Webwatcher-7B Success Rate: 49.1. Result ID: 69df659e47f34ce924c8b7e3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Method Category":"Multimodal Search Agent"}. This record does not assert independent reproduction. ### Kimi-K2.5 Success Rate: 47. Result ID: 69df659e47f34ce924c8b7d8. [Reporting paper]() Recorded evaluation configuration: {"Method Category":"Direct Answer"}. This record does not assert independent reproduction. ### Gemini-2.5-Pro Success Rate: 39.8. Result ID: 69df659e47f34ce924c8b7d9. [Reporting paper]() Recorded evaluation configuration: {"Method Category":"Direct Answer"}. This record does not assert independent reproduction. ### GPT-5 Success Rate: 33.3. Result ID: 69df659e47f34ce924c8b7d6. [Reporting paper]() Recorded evaluation configuration: {"Method Category":"Direct Answer"}. This record does not assert independent reproduction. ### Seed-1.8 Success Rate: 31. Result ID: 69df659e47f34ce924c8b7d7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Method Category":"Direct Answer"}. This record does not assert independent reproduction. ### Gemini-2.5-Flash Success Rate: 30.4. Result ID: 69df659e47f34ce924c8b7da. [Reporting paper]() Recorded evaluation configuration: {"Method Category":"Direct Answer"}. This record does not assert independent reproduction. ### Qwen3-VL-30B-A3B-Thinking Success Rate: 17.7. Result ID: 69df659e47f34ce924c8b7db. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Method Category":"Direct Answer"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.