Visual Question Answering on SimpleVQA
76.2Pass@1OpenSearch-VL-32B
Evaluation Results
| Method | Links | |
|---|---|---|
| OpenSearch-VL-32BWorkflow=Agentic Workflow2026.05 | 76.2 | |
| OpenSearch-VL-30B-A3BWorkflow=Agentic Workflow2026.05 | 74.9 | |
| OpenSearch-VL-8BWorkflow=Agentic Workflow2026.05 | 71.6 | |
| Seed2.0 Pro2026.06 | 71.4 | |
| Gemini-3-Pro High2026.06 | 69.7 | |
| Seed2.0 Mini2026.06 | 68.7 | |
| Seed2.0 Lite2026.06 | 67.2 | |
| Seed1.82026.06 | 65.4 | |
| GPT-4oWorkflow=RAG Workflow2026.05 | 63.6 | |
| Seed 1.5-VLthinking=true, decoding=greedy2025.05 | 63.4 | |
| Seed 1.5-VLthinking=false, decoding=greedy2025.05 | 63.1 | |
| Gemini-2.5-ProWorkflow=Direct Reasoning2026.05 | 63 | |
| Qwen3-VL-8BWorkflow=RAG Workflow2026.05 | 62.3 | |
| Gemini 1.5 Prothinking=true, decoding=greedy2025.05 | 62 | |
| SenseNova-MARS-8BWorkflow=Agentic Workflow2026.05 | 61.7 | |
| GPT-5Workflow=Direct Reasoning2026.05 | 61.6 | |
| DeepEyes-v2-7BWorkflow=Agentic Workflow2026.05 | 59.4 | |
| Claude-3.7-SonnetWorkflow=RAG Workflow2026.05 | 59.3 | |
| WebWatcher-32BWorkflow=Agentic Workflow2026.05 | 59 | |
| OpenAI o1thinking=true, decoding=greedy2025.05 | 58.8 | |
| Qwen3-VL-32BWorkflow=Agentic Workflow2026.05 | 58.7 | |
| Qwen3-VL-32BWorkflow=Direct Reasoning2026.05 | 58 | |
| Gemini-2.5-FlashWorkflow=Direct Reasoning2026.05 | 57.9 | |
| Claude-Opus-4.52026.06 | 57.9 | |
| MMSearch-R1-7BWorkflow=Agentic Workflow2026.05 | 57.4 | |
| GPT-5Workflow=RAG Workflow2026.05 | 55.9 | |
| DeepMMSearch-R1-7BWorkflow=Agentic Workflow2026.05 | 55.8 | |
| Qwen3-VL-30B-A3BWorkflow=Agentic Workflow2026.05 | 55.1 | |
| WebWatcher-7BWorkflow=Agentic Workflow2026.05 | 54.3 | |
| GPT-5.2 High2026.06 | 54.1 | |
| Qwen3-VL-30B-A3BWorkflow=Direct Reasoning2026.05 | 53.2 | |
| GPT-4othinking=false, decoding=greedy2025.05 | 52.4 | |
| Qwen 2.5-VL 72Bthinking=false, decoding=greedy2025.05 | 52.4 | |
| Qwen3-VL-8BWorkflow=Agentic Workflow2026.05 | 52 | |
| GPT-4oWorkflow=Direct Reasoning2026.05 | 51.7 | |
| Claude-4-SonnetWorkflow=Direct Reasoning2026.05 | 50.9 | |
| Claude 3.7 Sonnetthinking=true, decoding=sampling2025.05 | 50.1 | |
| Qwen3-VL-8BWorkflow=Direct Reasoning2026.05 | 47.1 | |
| Claude-3.7-SonnetWorkflow=Direct Reasoning2026.05 | 42.7 | |
| Visual-ARFT-7BWorkflow=Agentic Workflow2026.05 | 42.4 |