Room Navigation on Room Navigation Common Sense - CS
65.3Success RateSceneDiver
Evaluation Results
| Method | Links | |
|---|---|---|
| SceneDiverBackbone=gemini-2.5-flash, Model Category=Closed-Source2026.06 | 65.3 | |
| ThinkingBackbone=gemini-2.5-flash, Model Category=Closed-Source2026.06 | 63.3 | |
| SoMBackbone=gemini-2.5-flash, Model Category=Closed-Source2026.06 | 62.7 | |
| Base ModelBackbone=gemini-2.5-flash, Model Category=Closed-Source2026.06 | 62 | |
| Multi-ResBackbone=gemini-2.5-flash, Model Category=Closed-Source2026.06 | 60.7 | |
| SceneDiverBackbone=gpt-4o-mini, Model Category=Closed-Source2026.06 | 53.3 | |
| SceneDiverBackbone=Qwen2.5-VL-32B-Instruct-AWQ, Model Category=Open-Source2026.06 | 52.7 | |
| SceneDiverBackbone=doubao-seed-1.6-flash, Model Category=Closed-Source2026.06 | 48 | |
| Multi-ResBackbone=Qwen2.5-VL-32B-Instruct-AWQ, Model Category=Open-Source2026.06 | 46.7 | |
| VCDBackbone=Qwen2.5-VL-32B-Instruct-AWQ, Model Category=Open-Source2026.06 | 46 | |
| SoMBackbone=Qwen2.5-VL-32B-Instruct-AWQ, Model Category=Open-Source2026.06 | 44.7 | |
| Base ModelBackbone=Qwen2.5-VL-32B-Instruct-AWQ, Model Category=Open-Source2026.06 | 43.3 | |
| Multi-ResBackbone=doubao-seed-1.6-flash, Model Category=Closed-Source2026.06 | 41.3 | |
| ThinkingBackbone=doubao-seed-1.6-flash, Model Category=Closed-Source2026.06 | 41.3 | |
| Base ModelBackbone=doubao-seed-1.6-flash, Model Category=Closed-Source2026.06 | 40 | |
| SoMBackbone=doubao-seed-1.6-flash, Model Category=Closed-Source2026.06 | 40 | |
| Multi-ResBackbone=gpt-4o-mini, Model Category=Closed-Source2026.06 | 38.7 | |
| SoMBackbone=gpt-4o-mini, Model Category=Closed-Source2026.06 | 38 | |
| Base ModelBackbone=gpt-4o-mini, Model Category=Closed-Source2026.06 | 37.3 | |
| SceneDiverBackbone=Qwen2.5-VL-7B-Instruct-AWQ, Model Category=Open-Source2026.06 | 36 | |
| Multi-ResBackbone=Qwen2.5-VL-7B-Instruct-AWQ, Model Category=Open-Source2026.06 | 32.7 | |
| SceneDiverBackbone=InternVL2.5-8B, Model Category=Open-Source2026.06 | 32.7 | |
| VCDBackbone=Qwen2.5-VL-7B-Instruct-AWQ, Model Category=Open-Source2026.06 | 32 | |
| SoMBackbone=Qwen2.5-VL-7B-Instruct-AWQ, Model Category=Open-Source2026.06 | 31.3 | |
| Base ModelBackbone=Qwen2.5-VL-7B-Instruct-AWQ, Model Category=Open-Source2026.06 | 30.7 | |
| VCDBackbone=InternVL2.5-8B, Model Category=Open-Source2026.06 | 24.7 | |
| SoMBackbone=InternVL2.5-8B, Model Category=Open-Source2026.06 | 24 | |
| Base ModelBackbone=InternVL2.5-8B, Model Category=Open-Source2026.06 | 22.7 | |
| Multi-ResBackbone=InternVL2.5-8B, Model Category=Open-Source2026.06 | 20.7 |