Vision-centric Reasoning on RealWorldQA
75.4AccuracyGPT-4o
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-4omodel_category=Proprietary Model2025.09 | 75.4 | |
| SAPStrategy=SAP2026.02 | 73.3 | |
| Gemini2.0-Flashmodel_category=Proprietary Model2025.09 | 73.2 | |
| Qwen3-VL-8B-ThinkingStrategy=LongCoT2026.02 | 72.8 | |
| MiMo-VL-7B-RLOpen Model=Yes, Open Data=No2025.11 | 72.68 | |
| MiMo-VL-7B-SFTOpen Model=Yes, Open Data=No2025.11 | 71.9 | |
| Qwen3-VL-8B-InstructStrategy=Instruct2026.02 | 70.3 | |
| Long Grounded Thoughts (SFT + GRPO)Open Model=Yes, Open Data=Yes, Base Model=Qwen2.5-VL-7B-Instruct2025.11 | 69.02 | |
| VisionZero-Qwen-7B (Real-World)training_context=Real-World, base_model=Qwen2.5-VL-7B2025.09 | 68.9 | |
| Long Grounded Thoughts (Multistage SFT + DPO)Open Model=Yes, Open Data=Yes, Base Model=Qwen2.5-VL-7B-Instruct2025.11 | 68.76 | |
| Grok-1.5V2026.02 | 68.7 | |
| VisionZero-Qwen-7B (Chart)training_context=Chart, base_model=Qwen2.5-VL-7B2025.09 | 68.5 | |
| VisionZero-Qwen-7B (CLEVR)training_context=CLEVR, base_model=Qwen2.5-VL-7B2025.09 | 68.4 | |
| Qwen2.5-VL-7Bbase_model=Qwen2.5-VL-7B2025.09 | 68.1 | |
| Qwen2.5-VL-7B-InstructOpen Model=Yes, Open Data=No2025.11 | 67.84 | |
| Gemini-1.52026.02 | 67.5 | |
| Qwen2.5-VL-7B-Instruct + LongPerceptualThoughtsOpen Model=Yes, Open Data=Yes2025.11 | 67.45 | |
| Perceval#Param=7B2026.04 | 67.4 | |
| DeepEyes#Param=7B, Tool Capability=true2026.04 | 67 | |
| Qwen2.5-VL-7B-Instruct + VLAA-ThinkerOpen Model=Yes, Open Data=Yes2025.11 | 66.93 | |
| ViGaL-Snake+Rotationbase_model=Qwen2.5-VL-7B2025.09 | 66.5 | |
| OpenVLThinker#Param=7B2026.04 | 66.5 | |
| Qwen2.5-VL + GRPO#Param=7B2026.04 | 66.4 | |
| Long Grounded Thoughts (SFT + DPO)Open Model=Yes, Open Data=Yes, Base Model=Qwen2.5-VL-7B-Instruct2025.11 | 66.14 | |
| MM-Eureka-Qwen-7Bbase_model=Qwen2.5-VL-7B2025.09 | 66.1 | |
| Long Grounded Thoughts (SFT)Open Model=Yes, Open Data=Yes, Base Model=Qwen2.5-VL-7B-Instruct2025.11 | 65.49 | |
| VLAA-Thinker-7Bbase_model=Qwen2.5-VL-7B2025.09 | 65.4 | |
| Perceval#Param=3B2026.04 | 64.9 | |
| Vision-R1#Param=7B2026.04 | 64.1 | |
| Pixel-Reasoner#Param=7B, Tool Capability=true2026.04 | 64 | |
| VL-Rethinker#Param=7B2026.04 | 64 | |
| Qwen2.5-VL#Param=3B2026.04 | 63.4 | |
| AKI-4BModel Scale=4B, Model Access Type=Open-source2025.03 | 62.9 | |
| Qwen2.5-VL-7B-Instruct + Revisual-R1-finalOpen Model=Yes, Open Data=Yes2025.11 | 62.48 | |
| MM-Eureka#Param=7B2026.04 | 62.3 | |
| Qwen2.5-VL + GRPO#Param=3B2026.04 | 62.1 | |
| VLAA-Thinker#Param=7B2026.04 | 62 | |
| BLIP-3-4BModel Scale=4B, Model Access Type=Open-source2025.03 | 61.6 | |
| VLM-R1#Param=3B2026.04 | 61.5 | |
| GPT-4V2026.02 | 61.4 | |
| VisRefModel=SAIL-VL2-8B2026.02 | 61.2 | |
| Qwen2-VL-2BModel Scale=2B, Model Access Type=Open-source2025.03 | 60.7 | |
| Qwen2.5-VL#Param=7B2026.04 | 60.6 | |
| MolmoE-1B-7BAvg_k=8.002026.06 | 60.5 | |
| OpenVLThinker-7Bbase_model=Qwen2.5-VL-7B2025.09 | 60.2 | |
| GeMoEAvg_k=5.432026.06 | 60.1 | |
| R1-VL#Param=7B2026.04 | 59.5 | |
| VisRefModel=Qwen3-VL-8B2026.02 | 59.1 | |
| Phi-3-Vision-4BModel Scale=4B, Model Access Type=Open-source2025.03 | 58.8 | |
| LMM-R1#Param=3B2026.04 | 58.7 | |
| TSRModel=SAIL-VL2-8B2026.02 | 58 | |
| R1-OneVision-7Bbase_model=Qwen2.5-VL-7B2025.09 | 58 | |
| Jigsaw-R1#Param=3B2026.04 | 57.9 | |
| STModel=SAIL-VL2-8B2026.02 | 57.3 | |
| TSRModel=Qwen3-VL-8B2026.02 | 56.9 | |
| MM1.5-3BModel Scale=3B, Model Access Type=Proprietary2025.03 | 56.9 | |
| Perception-R1#Param=3B2026.04 | 55.8 | |
| MiniCPM-V2-3BModel Scale=3B, Model Access Type=Open-source2025.03 | 55.8 | |
| STModel=Qwen3-VL-8B2026.02 | 55.4 | |
| LLaVA-1.5-7BModel Scale=7B, Model Access Type=Open-source2025.03 | 54.8 | |
| VILA-1.5-3BModel Scale=3B, Model Access Type=Open-source2025.03 | 53.2 | |
| Claude-3-SonnetTable Header=Claude-S2026.02 | 51.9 | |
| Claude-3-OpusTable Header=Claude-O2026.02 | 49.8 | |
| DeepSeek-VL-1.3BModel Scale=1.3B, Model Access Type=Open-source2025.03 | 49.7 | |
| R1-VL#Param=2B2026.04 | 49.2 | |
| VisRefModel=InternVL3.5-8B2026.02 | 47.2 | |
| TSRModel=InternVL3.5-8B2026.02 | 44.9 | |
| STModel=InternVL3.5-8B2026.02 | 44.6 |