Spatial Reasoning on ReasonMap
55.1AccuracyGemini-2.5-Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-2.5-ProModel Type=Commercial2026.06 | 55.1 | |
| GPT-5Model Type=Commercial2026.06 | 53.8 | |
| w/o SFTModel Type=Ablation2026.06 | 45.1 | |
| Gemini-2.5-FlashModel Type=Commercial2026.06 | 43.2 | |
| Qwen3-235BModel Type=Open-Source2026.06 | 30.7 | |
| PERIA-8BModel Type=Proposed2026.06 | 27.1 | |
| w/o RLModel Type=Ablation2026.06 | 21.1 | |
| Qwen3-32BModel Type=Open-Source2026.06 | 20.6 | |
| Qwen3-30BModel Type=Open-Source2026.06 | 18.2 | |
| w/o ToolModel Type=Ablation2026.06 | 13.7 | |
| Qwen3-8BModel Type=Backbone Baseline2026.06 | 12.3 | |
| R1-OneVision-7BModel Type=Tool-Augmented2026.06 | 8.2 | |
| InternVL3.5-8BModel Type=Open-Source2026.06 | 5.8 | |
| InternVL3.5-14BModel Type=Open-Source2026.06 | 4.4 | |
| Mini-o3Model Type=Tool-Augmented2026.06 | 1.6 | |
| VTool-R1-7BModel Type=Tool-Augmented2026.06 | 1.5 |