Room Navigation on Room Navigation Complex Instruction - CI
66Success RateSceneDiver
Evaluation results
| Method | Links | |
|---|---|---|
| SceneDiverBackbone=gemini-2.5-flash, Model Category=Closed-Source2026.06 | 66 | |
| ThinkingBackbone=gemini-2.5-flash, Model Category=Closed-Source2026.06 | 63.3 | |
| Multi-ResBackbone=gemini-2.5-flash, Model Category=Closed-Source2026.06 | 61.3 | |
| SoMBackbone=gemini-2.5-flash, Model Category=Closed-Source2026.06 | 60.7 | |
| Base ModelBackbone=gemini-2.5-flash, Model Category=Closed-Source2026.06 | 60 | |
| SceneDiverBackbone=Qwen2.5-VL-32B-Instruct-AWQ, Model Category=Open-Source2026.06 | 53.3 | |
| Multi-ResBackbone=Qwen2.5-VL-32B-Instruct-AWQ, Model Category=Open-Source2026.06 | 49.3 | |
| SceneDiverBackbone=gpt-4o-mini, Model Category=Closed-Source2026.06 | 49.3 | |
| SceneDiverBackbone=doubao-seed-1.6-flash, Model Category=Closed-Source2026.06 | 48.7 | |
| SoMBackbone=Qwen2.5-VL-32B-Instruct-AWQ, Model Category=Open-Source2026.06 | 48 | |
| Base ModelBackbone=Qwen2.5-VL-32B-Instruct-AWQ, Model Category=Open-Source2026.06 | 46.7 | |
| VCDBackbone=Qwen2.5-VL-32B-Instruct-AWQ, Model Category=Open-Source2026.06 | 45.3 | |
| ThinkingBackbone=doubao-seed-1.6-flash, Model Category=Closed-Source2026.06 | 43.3 | |
| Multi-ResBackbone=doubao-seed-1.6-flash, Model Category=Closed-Source2026.06 | 42 | |
| Multi-ResBackbone=gpt-4o-mini, Model Category=Closed-Source2026.06 | 41.3 | |
| SoMBackbone=doubao-seed-1.6-flash, Model Category=Closed-Source2026.06 | 40.7 | |
| Base ModelBackbone=gpt-4o-mini, Model Category=Closed-Source2026.06 | 38.7 | |
| Base ModelBackbone=doubao-seed-1.6-flash, Model Category=Closed-Source2026.06 | 38 | |
| SceneDiverBackbone=Qwen2.5-VL-7B-Instruct-AWQ, Model Category=Open-Source2026.06 | 37.3 | |
| SoMBackbone=gpt-4o-mini, Model Category=Closed-Source2026.06 | 36 | |
| Multi-ResBackbone=Qwen2.5-VL-7B-Instruct-AWQ, Model Category=Open-Source2026.06 | 34 | |
| SceneDiverBackbone=InternVL2.5-8B, Model Category=Open-Source2026.06 | 33.3 | |
| VCDBackbone=Qwen2.5-VL-7B-Instruct-AWQ, Model Category=Open-Source2026.06 | 32.7 | |
| Base ModelBackbone=Qwen2.5-VL-7B-Instruct-AWQ, Model Category=Open-Source2026.06 | 32 | |
| SoMBackbone=Qwen2.5-VL-7B-Instruct-AWQ, Model Category=Open-Source2026.06 | 31.3 | |
| Multi-ResBackbone=InternVL2.5-8B, Model Category=Open-Source2026.06 | 30.7 | |
| VCDBackbone=InternVL2.5-8B, Model Category=Open-Source2026.06 | 28 | |
| Base ModelBackbone=InternVL2.5-8B, Model Category=Open-Source2026.06 | 24 | |
| SoMBackbone=InternVL2.5-8B, Model Category=Open-Source2026.06 | 23.3 |