Mental Navigation on Video2Mental Short
2.39Navigation Error (NE)NavMind-Stage1
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| NavMind-Stage1Category=Spatial Reasoning Models2026.03 | 2.39 | 51.1 | 40.4 | 36.8 | |
| NavMind-Stage2Category=Spatial Reasoning Models2026.03 | 2.44 | 50.3 | 40.1 | 36.5 | |
| GPT-5.1Category=Proprietary Multimodal Large Language Models2026.03 | 4.31 | 13.4 | 9.2 | 6.8 | |
| Claude-Sonnet-4.6Category=Proprietary Multimodal Large Language Models2026.03 | 4.45 | 11.1 | 7.9 | 6.6 | |
| Qwen3.5-397BCategory=Open-Source Multimodal Large Language Models2026.03 | 4.6 | 13.6 | 7.2 | 5.3 | |
| Gemini-3-ProCategory=Proprietary Multimodal Large Language Models2026.03 | 4.65 | 8.7 | 4.2 | 3.2 | |
| Qwen3-VL-8BCategory=Open-Source Multimodal Large Language Models2026.03 | 5.2 | 6.1 | 7 | 6.1 | |
| Qwen3-VL-30BCategory=Open-Source Multimodal Large Language Models2026.03 | 5.74 | 4.2 | 5.8 | 4.6 | |
| InternVL-3.5-8BCategory=Open-Source Multimodal Large Language Models2026.03 | 6.64 | 1 | 1.9 | 1.9 | |
| RynnBrain-8BCategory=Spatial Reasoning Models2026.03 | 8.43 | 0 | 0 | 0 | |
| Cambrian-SCategory=Spatial Reasoning Models2026.03 | 9.34 | 2.1 | 3.9 | 3.6 |