Spatial Reasoning on Visual Spatial Reasoning (VSR)
95.4AccuracyHuman Estimate
Evaluation results
| Method | Links | |
|---|---|---|
| Human Estimate2025.04 | 95.4 | |
| Qwen2.5-VL2026.01 | 89.116 | |
| SpaRE-7BModel size=7B2025.04 | 85.4 | |
| GPT-5-miniGrounded=false2025.12 | 84.4 | |
| Qwen3-VL-4B-Thinking + DiGParameter Scale=4B, Thinking Mode=true, Grounding Strategy=DiG2025.12 | 83.9 | |
| Qwen3-VL-8B-Thinking + DiGParameter Scale=8B, Thinking Mode=true, Grounding Strategy=DiG2025.12 | 83 | |
| Qwen3-VL-8B-ThinkingParameter Scale=8B, Thinking Mode=true2025.12 | 82.6 | |
| Qwen3-VL-4B-ThinkingParameter Scale=4B, Thinking Mode=true2025.12 | 82.5 | |
| GPT-5-miniGrounded=true2025.12 | 82.4 | |
| Qwen2VL-7BModel size=7B2025.04 | 82.3 | |
| SpaRE-2BModel size=2B2025.04 | 80.8 | |
| GPT-4o2025.04 | 79 | |
| LLaVA-OneVision2026.01 | 77.741 | |
| Qwen2.5-VL-7BParameter Scale=7B2025.12 | 77.7 | |
| Molmo2026.01 | 76.432 | |
| VALOR2025.12 | 75.6 | |
| GPT-4oZero-shot=true2025.02 | 74.8 | |
| GPT-4o-mini2025.04 | 74 | |
| InternVL2-8BModel size=8B2025.04 | 73.1 | |
| LLaVA-NeXT-8BModel size=8B2025.04 | 71.9 | |
| SmolVLM22026.01 | 71.277 | |
| Qwen2VL-2BModel size=2B2025.04 | 70.3 | |
| InternVL2-2BModel size=2B2025.04 | 68.7 | |
| SpaceLLaVa2025.04 | 65.9 | |
| PaliGemma2026.01 | 65.139 | |
| Magma-8B (Full)Zero-shot=true, SoM/ToM pre-training=with2025.02 | 65.1 | |
| LLaVA-NeXT2026.01 | 63.994 | |
| Magma-8B (Act)Zero-shot=true, SoM/ToM pre-training=without2025.02 | 62.8 | |
| LLaVA-AIMv2-2D-RoPEencoder=AIMv2, positional_embedding=2D-RoPE2026.01 | 60.311 | |
| Magma-8B (Full)Zero-shot=true, SoM/ToM pre-training=without2025.02 | 58.1 | |
| LLaVA-SigLIP-2D-RoPEencoder=SigLIP, positional_embedding=2D-RoPE2026.01 | 57.692 | |
| LLaVA-2D-RoPEpositional_embedding=2D-RoPE2026.01 | 57.201 | |
| LLaVA-1.5-7BZero-shot=true, evaluated_by_paper_authors=true2025.02 | 57.1 | |
| LLaVA-SigLIP2-2D-RoPEencoder=SigLIP2, positional_embedding=2D-RoPE2026.01 | 56.465 | |
| LLaVA-AIMv2encoder=AIMv22026.01 | 56.219 | |
| LLaVA v1.52026.01 | 55.81 | |
| Gemma3-4b-it2026.01 | 55.074 | |
| LLaVA-SigLIPencoder=SigLIP2026.01 | 54.91 | |
| CLIP-ViT-H-142026.01 | 54.5 | |
| CLIP-ViT-B/322026.01 | 53.7 | |
| MiniCPM-V 4.5Prompting Strategy=General2026.01 | 53 | |
| LLaVA-SigLIP2encoder=SigLIP22026.01 | 52.701 | |
| LLaVA-1.6-7BZero-shot=true, evaluated_by_paper_authors=true2025.02 | 52.2 | |
| InternVL3.5 8BPrompting Strategy=Task-Aware2026.01 | 52 | |
| InternVL3.5 8BPrompting Strategy=General2026.01 | 51.6 | |
| MiniCPM-V 4.5Prompting Strategy=Task-Aware2026.01 | 51.4 | |
| Random2025.04 | 50 | |
| Random2026.01 | 50 |