Multimodal Search-based Question Answering on MMSearch
69.6AccuracyVision-DeepResearch-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| Vision-DeepResearch-8BWorkflow=Agent Workflow2026.01 | 69.6 | |
| Vision-DeepResearch-30B-A3BWorkflow=Agent Workflow2026.01 | 69.6 | |
| Gemini-2.5 ProWorkflow=Agent Workflow2026.01 | 69 | |
| Claude-4-SonnetWorkflow=Agent Workflow2026.01 | 67.2 | |
| GoG-3-8B-Think-RLEvaluation Methodology=Search-Equipped Models2026.01 | 65.5 | |
| Gemini-2.5 FlashWorkflow=Agent Workflow2026.01 | 64 | |
| Qwen3-VL-8B-ThinkingEvaluation Methodology=Full-Search Workflow2026.01 | 63.84 | |
| GPT-5Workflow=Agent Workflow2026.01 | 63.7 | |
| Claude-3.7-SonnetWorkflow=Agent Workflow2026.01 | 63.7 | |
| DeepEyesV2Tool=General, Model Size=7B2025.11 | 63.7 | |
| DeepEyesV2Backbone=Qwen2.5-VL-7B2025.08 | 63.7 | |
| GoG-2.5-7B-RLEvaluation Methodology=Search-Equipped Models2026.01 | 56.73 | |
| Webwatcher-32BWorkflow=Multimodal DeepResearch MLLM2026.01 | 55.3 | |
| Qwen3-VL-30B-A3B-InstructWorkflow=Agent Workflow2026.01 | 55 | |
| PMSRBackbone=Qwen2.5-VL-7B2025.08 | 54.3 | |
| MMSearch-R1-7BWorkflow=Multimodal DeepResearch MLLM2026.01 | 53.8 | |
| GoG-3-8B-Think-SFTEvaluation Methodology=Search-Equipped Models2026.01 | 53.8 | |
| MMSearch-R1Tool=Search, Model Size=7B2025.11 | 53.8 | |
| MMSearch-R1Backbone=Qwen2.5-VL-7B2025.08 | 53.8 | |
| Qwen3-VL-30B-A3B-ThinkingWorkflow=Agent Workflow2026.01 | 53.2 | |
| Qwen-2.5-VLTool=Search, Model Size=7B2025.11 | 52.2 | |
| Qwen3-VL-8B-InstructWorkflow=Agent Workflow2026.01 | 52 | |
| OmniSearchBackbone=GPT-4o2025.08 | 49.7 | |
| Webwatcher-7BWorkflow=Multimodal DeepResearch MLLM2026.01 | 49.1 | |
| WebWatcherTool=Search, Model Size=7B2025.11 | 49.1 | |
| WebWatcherBackbone=Qwen2.5-VL-7B2025.08 | 49.1 | |
| Qwen3-VL-8B-ThinkingWorkflow=Agent Workflow2026.01 | 45.6 | |
| Gemini-2.5-flashWorkflow=RAG Workflow2026.01 | 43.9 | |
| MMSearch-R1*Evaluation Methodology=Search-Equipped Models2026.01 | 40.94 | |
| GoG-2.5-7B-SFTEvaluation Methodology=Search-Equipped Models2026.01 | 40.35 | |
| Gemini-2.5 ProWorkflow=Direct Answer2026.01 | 39.8 | |
| Qwen3-VL-8B-ThinkEvaluation Methodology=Prompt-based GoG Method2026.01 | 36.84 | |
| Qwen2.5-VL-7BEvaluation Methodology=Full-Search Workflow2026.01 | 36.26 | |
| GPT-5Workflow=Direct Answer2026.01 | 33.3 | |
| Claude-3.7-SonnetWorkflow=RAG Workflow2026.01 | 32.7 | |
| Gemini-2.5 FlashWorkflow=Direct Answer2026.01 | 30.4 | |
| Qwen-2.5-VL-72BWorkflow=RAG Workflow2026.01 | 29.2 | |
| Gemini 2.5 ProTool=✗, Model Size=-2025.11 | 26.9 | |
| GPT4oTool=✗, Model Size=-2025.11 | 22.2 | |
| GPT-4oEvaluation Methodology=Direct Answer2026.01 | 21.64 | |
| PIXELRAGReader=Qwen3-VL-4B, Top-k=3, Retrieval Category=Pixel-based retrieval2026.06 | 21.6 | |
| Claude-3.7-SonnetWorkflow=Direct Answer2026.01 | 21.1 | |
| Qwen2.5-VL-7BEvaluation Methodology=Prompt-based GoG Method2026.01 | 20.47 | |
| PIXELRAG (base)Reader=Qwen3-VL-4B, Top-k=3, Retrieval Category=Pixel-based retrieval2026.06 | 19.9 | |
| Qwen3-VL-30B-A3B-ThinkingWorkflow=Direct Answer2026.01 | 19.3 | |
| Claude-4-SonnetWorkflow=Direct Answer2026.01 | 18.7 | |
| Qwen3-VL-30B-A3B-InstructWorkflow=Direct Answer2026.01 | 18.7 | |
| Qwen3-VL-30B-A3B-InstructEvaluation Methodology=Direct Answer2026.01 | 18.13 | |
| Qwen3-VL-30B-A3B-ThinkingEvaluation Methodology=Direct Answer2026.01 | 17.54 | |
| Qwen2.5-VL-32BEvaluation Methodology=Direct Answer2026.01 | 16.37 | |
| Qwen3-VL-8B-ThinkingWorkflow=Direct Answer2026.01 | 15.8 | |
| Qwen3-VL-8B-InstructWorkflow=Direct Answer2026.01 | 15.2 | |
| Qwen3-VL-8B-InstructEvaluation Methodology=Direct Answer2026.01 | 15.2 | |
| Qwen3-VL-8B-ThinkingEvaluation Methodology=Direct Answer2026.01 | 15.2 | |
| Qwen2.5-VL-7BEvaluation Methodology=Direct Answer2026.01 | 14.62 | |
| No retrievalReader=Qwen3-VL-4B, Top-k=3, Retrieval Category=None2026.06 | 13.5 | |
| TrafilaturaReader=Qwen3-VL-4B, Top-k=3, Retrieval Category=Text-based retrieval2026.06 | 13.5 | |
| mwparserfromhellReader=Qwen3-VL-4B, Top-k=3, Retrieval Category=Text-based retrieval2026.06 | 12.9 | |
| Qwen-2.5-VLTool=✗, Model Size=7B2025.11 | 12.8 |