Instruction-based Navigation on Scene 3 Laboratory storage 1.0 (overall)
58SRnavgemini
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| geminiModel=Google Gemini2026.01 | 58 | 74 | 57 | 4 | |
| SpatialMem2026.01 | 54 | 83 | 58 | 4.6 | |
| internvl (Entry 2)Model=InternVL 2.5, Deployment=Local2026.01 | 53 | 66 | 48 | 4.8 | |
| internvl (Entry 1)Model=InternVL 2.5, Deployment=Local2026.01 | 52 | 72 | 55 | 4.2 | |
| llavaModel=LLaVA-Video, Deployment=Local2026.01 | 49 | 70 | 53 | 4.4 | |
| openaiModel=OpenAI GPT-4o2026.01 | 49 | 64 | 46 | 5 | |
| togetherModel=Qwen2.5-VL, Deployment=Cloud2026.01 | 39 | 60 | 41 | 5.5 | |
| qwen25vlModel=Qwen2.5-VL, Deployment=Local2026.01 | 38 | 53 | 35 | 6.1 |