Multimodal Search on SimpleVQA (Accuracy)
64.1AccuracyGemini-3-Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-3-ProModel Type=Proprietary, Tool Usage=Web Tools2026.03 | 64.1 | |
| GPT-5Model Type=Proprietary, Tool Usage=Web Tools2026.03 | 62.3 | |
| Gemini-3-FlashModel Type=Proprietary, Tool Usage=Web Tools2026.03 | 60.8 | |
| Qwen3-VL-PlusModel Type=Proprietary, Tool Usage=Web Tools2026.03 | 58.4 | |
| DeepMMSearch-R1Model Type=Agentic2026.03 | 55.8 | |
| VSearcherModel Type=Agentic2026.03 | 46.6 | |
| Qwen3-VL-30B-A3B-ThinkingModel Type=Open-source, Tool Usage=Web Tools2026.03 | 46.3 | |
| Qwen3-VL-8B-ThinkingModel Type=Open-source, Tool Usage=Web Tools2026.03 | 45.5 | |
| DeepEyesV2Model Type=Agentic2026.03 | 44.4 | |
| Qwen3-VL-4B-ThinkingModel Type=Open-source, Tool Usage=Web Tools2026.03 | 41.1 | |
| GPT-4oModel Type=Proprietary, Tool Usage=Web Tools2026.03 | 40 | |
| MMSearch-R1Model Type=Agentic2026.03 | 40 | |
| InternVL3.5-38BModel Type=Open-source, Tool Usage=Web Tools2026.03 | 39.7 | |
| InternVL3.5-8BModel Type=Open-source, Tool Usage=Web Tools2026.03 | 38.8 | |
| Qwen2.5-VL-72B-InstructModel Type=Open-source, Tool Usage=Web Tools2026.03 | 37.7 |