Precise Movement on NavSpace
4.5Navigation Error (NE)SNav
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SNavModel Category=Navigation Large Models, Ablation Component=w/o Cross-floor Navigation2025.10 | 4.5 | 16.9 | 8 | |
| SNavModel Category=Navigation Large Models2025.10 | 4.68 | 19.9 | 12.4 | |
| SNavModel Category=Navigation Large Models, Ablation Component=w/o Spatial Relationship2025.10 | 4.87 | 14.4 | 6.5 | |
| SNavModel Category=Navigation Large Models, Ablation Component=w/o Environment State2025.10 | 4.99 | 19.4 | 8 | |
| SNavModel Category=Navigation Large Models, Ablation Component=w/o Precise Movement2025.10 | 4.99 | 19.4 | 8 | |
| Gemini 2.5 ProModel Category=Proprietary MLLMs2025.10 | 5.09 | 12.4 | 4 | |
| CMAModel Category=Lightweight Nav Models2025.10 | 5.56 | 13.4 | 0 | |
| HPN+DNModel Category=Lightweight Nav Models2025.10 | 5.59 | 15.4 | 3.5 | |
| StreamVLNModel Category=Navigation Large Models2025.10 | 5.59 | 18.9 | 8 | |
| GPT-5Model Category=Proprietary MLLMs2025.10 | 5.69 | 12.4 | 3 | |
| NaVidModel Category=Navigation Large Models2025.10 | 5.83 | 21.9 | 7 | |
| Qwen2.5-VL 7BModel Category=Open-source MLLMs2025.10 | 5.96 | 10.9 | 2.5 | |
| GPT-5 MiniModel Category=Proprietary MLLMs2025.10 | 6.31 | 9.5 | 4 | |
| Gemini 2.5 FlashModel Category=Proprietary MLLMs2025.10 | 6.32 | 11.4 | 4 | |
| BEVBertModel Category=Lightweight Nav Models2025.10 | 6.33 | 7 | 2 | |
| GLM-4.1V-Thinking 9BModel Category=Open-source MLLMs2025.10 | 6.35 | 9.5 | 2 | |
| LLaVA-Video 7BModel Category=Open-source MLLMs2025.10 | 6.36 | 11.9 | 3.5 | |
| GLM-4.5V 106BModel Category=Open-source MLLMs2025.10 | 6.39 | 9.5 | 2.5 | |
| Qwen2.5-VL 72BModel Category=Open-source MLLMs2025.10 | 6.42 | 9.5 | 3 | |
| GPT-4oModel Category=Proprietary MLLMs2025.10 | 6.5 | 11.4 | 4 | |
| Seq2SeqModel Category=Lightweight Nav Models2025.10 | 6.85 | 12.9 | 0 | |
| Chance Level (Frequency)Model Category=Chance Level Baselines2025.10 | 6.94 | 12.9 | 3.5 | |
| Chance Level (Random)Model Category=Chance Level Baselines2025.10 | 7.23 | 7.5 | 1 | |
| NaVILAModel Category=Navigation Large Models2025.10 | 7.26 | 2.5 | 2.5 | |
| VLN⟳BERTModel Category=Lightweight Nav Models2025.10 | 7.3 | 6.5 | 1.5 | |
| Sim2SimModel Category=Lightweight Nav Models2025.10 | 7.46 | 6 | 6 | |
| ETPNavModel Category=Lightweight Nav Models2025.10 | 7.7 | 10 | 2.5 |