Embodied Navigation on EB-Navigation
85Average ScoreGPT-5
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GPT-5Tool use=Yes2026.05 | 85 | 85 | 87 | 85 | 83 | 85 | |
| Claude-4.6Tool use=Yes2026.05 | 85 | 85 | 85 | 85 | 85 | 85 | |
| Qwen3-32BTool use=Yes2026.05 | 84 | 83 | 82 | 85 | 82 | 87 | |
| GPT-4oTool use=Yes2026.05 | 83 | 80 | 85 | 85 | 80 | 83 | |
| Claude-3.7Tool use=Yes2026.05 | 83 | 85 | 82 | 83 | 85 | 82 | |
| Qwen2.5-32BTool use=Yes2026.05 | 81 | 75 | 83 | 83 | 82 | 83 | |
| Qwen3.5-35BTool use=Yes2026.05 | 81 | 80 | 80 | 80 | 83 | 82 | |
| Qwen3-8BTool use=Yes2026.05 | 80 | 85 | 85 | 77 | 75 | 77 | |
| Claude-4.6Tool use=No2026.05 | 62 | 68 | 63 | 77 | 55 | 48 | |
| MuSixbackbone=Qwen3-VL-4B-Instruct, world model groups (G)=3, world models (K)=15, top-k models=4, alpha_max=0.3, gamma=1.02026.07 | 57.92 | 63.2 | 63.2 | 57.6 | 62.4 | 43.2 | |
| GPT-5Tool use=No2026.05 | 57 | 62 | 62 | 68 | 50 | 42 | |
| Claude-3.7Tool use=No2026.05 | 55 | 67 | 62 | 63 | 50 | 35 | |
| SayCanPay2026.07 | 47.2 | 54.4 | 47.2 | 57.6 | 48 | 28.8 | |
| GPT-4oTool use=No2026.05 | 46 | 58 | 50 | 47 | 33 | 43 | |
| Qwen3-8BTool use=No2026.05 | 42 | 62 | 48 | 45 | 32 | 22 | |
| Qwen3-32BTool use=No2026.05 | 40 | 52 | 47 | 55 | 35 | 10 | |
| Qwen3.5-35BTool use=No2026.05 | 39 | 50 | 42 | 48 | 47 | 7 | |
| Qwen2.5-32BTool use=No2026.05 | 35 | 48 | 42 | 33 | 30 | 23 | |
| FLAREparadigm=retrieval-augmented generation2026.07 | 34.24 | 45.6 | 35.2 | 44 | 32 | 14.4 | |
| Conventional MoErouting=standard top-k routing2026.07 | 29.28 | 36 | 28.8 | 39.2 | 32.8 | 9.6 | |
| LLM-Plannerparadigm=few-shot prompting without explicit world modeling2026.07 | 24.96 | 36.8 | 30.4 | 27.2 | 28.8 | 1.6 |