Vertical Perception on NavSpace
5.03Navigation Error (NE)SNav
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SNavModel Category=Navigation Large Models2025.10 | 5.03 | 30.4 | 23.7 | |
| SNavModel Category=Navigation Large Models2025.10 | 5.3 | 36.5 | 28.8 | |
| Gemini 2.5 ProModel Category=Proprietary MLLMs2025.10 | 5.42 | 30.3 | 23.6 | |
| GPT-5Model Category=Proprietary MLLMs2025.10 | 5.47 | 22.6 | 18.3 | |
| NaVidModel Category=Navigation Large Models2025.10 | 5.56 | 31.7 | 23.1 | |
| SNavModel Category=Navigation Large Models, Ablation Component=w/o Cross-floor Navigation2025.10 | 5.61 | 31.3 | 24 | |
| GPT-5 MiniModel Category=Proprietary MLLMs2025.10 | 5.81 | 19.7 | 15.4 | |
| SNavModel Category=Navigation Large Models, Ablation Component=w/o Environment State2025.10 | 5.86 | 26.9 | 17.8 | |
| SNavModel Category=Navigation Large Models, Ablation Component=w/o Precise Movement2025.10 | 5.93 | 27.4 | 18.8 | |
| StreamVLNModel Category=Navigation Large Models2025.10 | 6 | 35.1 | 23.1 | |
| SNavModel Category=Navigation Large Models, Ablation Component=w/o Spatial Relationship2025.10 | 6.01 | 22.6 | 15.9 | |
| GPT-4oModel Category=Proprietary MLLMs2025.10 | 6.04 | 16.3 | 10.1 | |
| LLaVA-Video 7BModel Category=Open-source MLLMs2025.10 | 6.09 | 13.9 | 7.7 | |
| Chance Level (Frequency)Model Category=Chance Level Baselines2025.10 | 6.23 | 23.2 | 11.6 | |
| Qwen2.5-VL 7BModel Category=Open-source MLLMs2025.10 | 6.29 | 11.1 | 6.3 | |
| Gemini 2.5 FlashModel Category=Proprietary MLLMs2025.10 | 6.3 | 11.5 | 3.8 | |
| Qwen2.5-VL 72BModel Category=Open-source MLLMs2025.10 | 6.56 | 12 | 9.1 | |
| VLN⟳BERTModel Category=Lightweight Nav Models2025.10 | 6.57 | 0.5 | 0.5 | |
| CMAModel Category=Lightweight Nav Models2025.10 | 6.6 | 1.9 | 0.5 | |
| BEVBertModel Category=Lightweight Nav Models2025.10 | 6.6 | 8.2 | 4.3 | |
| HPN+DNModel Category=Lightweight Nav Models2025.10 | 6.62 | 10.6 | 8.7 | |
| Chance Level (Random)Model Category=Chance Level Baselines2025.10 | 6.65 | 12.6 | 3.9 | |
| NaVILAModel Category=Navigation Large Models2025.10 | 6.71 | 3.8 | 3.4 | |
| Sim2SimModel Category=Lightweight Nav Models2025.10 | 6.72 | 0.5 | 0.5 | |
| GLM-4.5V 106BModel Category=Open-source MLLMs2025.10 | 6.75 | 20.7 | 7.7 | |
| GLM-4.1V-Thinking 9BModel Category=Open-source MLLMs2025.10 | 6.85 | 17.3 | 7.7 | |
| Chance Level (Frequency)Model Category=Chance Level Baselines2025.10 | 6.9 | 22.1 | 11.5 | |
| Chance Level (Random)Model Category=Chance Level Baselines2025.10 | 6.92 | 14.4 | 4.3 | |
| ETPNavModel Category=Lightweight Nav Models2025.10 | 6.98 | 6.7 | 3.4 | |
| Seq2SeqModel Category=Lightweight Nav Models2025.10 | 7.88 | 2.9 | 1 |