Spatial Reasoning on MapEval
72.7AccuracyGPT-5
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-5Model Type=Commercial2026.06 | 72.7 | |
| Gemini-2.5-FlashModel Type=Commercial2026.06 | 71 | |
| Gemini-2.5-ProModel Type=Commercial2026.06 | 71 | |
| Qwen3-235BModel Type=Open-Source2026.06 | 69 | |
| Qwen3-32BModel Type=Open-Source2026.06 | 67.2 | |
| Qwen3-30BModel Type=Open-Source2026.06 | 64.7 | |
| w/o ToolModel Type=Ablation2026.06 | 59 | |
| PERIA-8BModel Type=Proposed2026.06 | 55.5 | |
| w/o RLModel Type=Ablation2026.06 | 54.8 | |
| InternVL3.5-14BModel Type=Open-Source2026.06 | 54 | |
| Qwen3-8BModel Type=Backbone Baseline2026.06 | 54 | |
| InternVL3.5-8BModel Type=Open-Source2026.06 | 53.7 | |
| w/o SFTModel Type=Ablation2026.06 | 49.5 | |
| Mini-o3Model Type=Tool-Augmented2026.06 | 46.7 | |
| VTool-R1-7BModel Type=Tool-Augmented2026.06 | 45.7 | |
| R1-OneVision-7BModel Type=Tool-Augmented2026.06 | 45.2 |