Route Tracing on MapTrace
82.4Accuracyw/o Tool
Evaluation results
| Method | Links | |
|---|---|---|
| w/o ToolModel Type=Ablation2026.06 | 82.4 | |
| GPT-5Model Type=Commercial2026.06 | 82.2 | |
| Gemini-2.5-ProModel Type=Commercial2026.06 | 80.4 | |
| PERIA-8BModel Type=Proposed2026.06 | 77.7 | |
| InternVL3.5-14BModel Type=Open-Source2026.06 | 76.2 | |
| Qwen3-32BModel Type=Open-Source2026.06 | 75.5 | |
| Qwen3-30BModel Type=Open-Source2026.06 | 75 | |
| w/o RLModel Type=Ablation2026.06 | 74.2 | |
| Qwen3-8BModel Type=Backbone Baseline2026.06 | 74.1 | |
| Qwen3-235BModel Type=Open-Source2026.06 | 72.9 | |
| w/o SFTModel Type=Ablation2026.06 | 71.1 | |
| InternVL3.5-8BModel Type=Open-Source2026.06 | 70.8 | |
| Gemini-2.5-FlashModel Type=Commercial2026.06 | 66.4 | |
| VTool-R1-7BModel Type=Tool-Augmented2026.06 | 45.2 | |
| R1-OneVision-7BModel Type=Tool-Augmented2026.06 | 41.9 | |
| Mini-o3Model Type=Tool-Augmented2026.06 | 30.4 |