List your company
ResearchFormerly WizWand

Visual Question Answering on SimpleVQA

76.2Pass@1OpenSearch-VL-32B
41.04850.17459.368.426May 11, 2025Jul 19, 2025Sep 26, 2025Dec 4, 2025Feb 11, 2026Apr 21, 2026Jun 30, 2026
Updated 4mo ago

Evaluation results

MethodLinks
OpenSearch-VL-32BWorkflow=Agentic Workflow2026.0576.2
OpenSearch-VL-30B-A3BWorkflow=Agentic Workflow2026.0574.9
OpenSearch-VL-8BWorkflow=Agentic Workflow2026.0571.6
Seed2.0 Pro2026.0671.4
Gemini-3-Pro High2026.0669.7
Seed2.0 Mini2026.0668.7
Seed2.0 Lite2026.0667.2
Seed1.82026.0665.4
GPT-4oWorkflow=RAG Workflow2026.0563.6
Seed 1.5-VLthinking=true, decoding=greedy2025.0563.4
Seed 1.5-VLthinking=false, decoding=greedy2025.0563.1
Gemini-2.5-ProWorkflow=Direct Reasoning2026.0563
Qwen3-VL-8BWorkflow=RAG Workflow2026.0562.3
Gemini 1.5 Prothinking=true, decoding=greedy2025.0562
SenseNova-MARS-8BWorkflow=Agentic Workflow2026.0561.7
GPT-5Workflow=Direct Reasoning2026.0561.6
DeepEyes-v2-7BWorkflow=Agentic Workflow2026.0559.4
Claude-3.7-SonnetWorkflow=RAG Workflow2026.0559.3
WebWatcher-32BWorkflow=Agentic Workflow2026.0559
OpenAI o1thinking=true, decoding=greedy2025.0558.8
Qwen3-VL-32BWorkflow=Agentic Workflow2026.0558.7
Qwen3-VL-32BWorkflow=Direct Reasoning2026.0558
Gemini-2.5-FlashWorkflow=Direct Reasoning2026.0557.9
Claude-Opus-4.52026.0657.9
MMSearch-R1-7BWorkflow=Agentic Workflow2026.0557.4
GPT-5Workflow=RAG Workflow2026.0555.9
DeepMMSearch-R1-7BWorkflow=Agentic Workflow2026.0555.8
Qwen3-VL-30B-A3BWorkflow=Agentic Workflow2026.0555.1
WebWatcher-7BWorkflow=Agentic Workflow2026.0554.3
GPT-5.2 High2026.0654.1
Qwen3-VL-30B-A3BWorkflow=Direct Reasoning2026.0553.2
GPT-4othinking=false, decoding=greedy2025.0552.4
Qwen 2.5-VL 72Bthinking=false, decoding=greedy2025.0552.4
Qwen3-VL-8BWorkflow=Agentic Workflow2026.0552
GPT-4oWorkflow=Direct Reasoning2026.0551.7
Claude-4-SonnetWorkflow=Direct Reasoning2026.0550.9
Claude 3.7 Sonnetthinking=true, decoding=sampling2025.0550.1
Qwen3-VL-8BWorkflow=Direct Reasoning2026.0547.1
Claude-3.7-SonnetWorkflow=Direct Reasoning2026.0542.7
Visual-ARFT-7BWorkflow=Agentic Workflow2026.0542.4