Visual Planning on Maze (Path Metrics)
7.2Path Length Metric 3LLaVA-OneVision-7B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LLaVA-OneVision-7BInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 7.2 | 4 | 5.6 | 4.4 | 5.3 | |
| InternVL3-8BInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 10 | 7.6 | 7.6 | 4 | 7.3 | |
| Qwen2.5-VL-3B-InstructInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 10 | 5.6 | 5.6 | 5.2 | 6.6 | |
| Qwen2.5-VL-7B-InstructInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 11.2 | 6 | 10.8 | 3.6 | 7.9 | |
| Qwen3-VL-4B-InstructInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 24.4 | 12 | 5.2 | 4.8 | 11.6 | |
| Qwen3-VL-235B-A22B-InstructInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 32 | 24 | 22.4 | 16.4 | 23.7 | |
| Claude-4.5-HaikuInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 34.8 | 30 | 21.6 | 15.2 | 25.4 | |
| Qwen3-VL-8B-InstructInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 35.2 | 20 | 15.2 | 8.8 | 19.8 | |
| GPT-4oInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 38 | 30.4 | 20.4 | 16.8 | 26.4 | |
| Gemini-2.5-ProInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 41.2 | 21.6 | 13.6 | 8.8 | 21.3 | |
| Gemini-2.5-FlashInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 44 | 32.8 | 22.8 | 15.6 | 28.8 | |
| MGSD-4BInput Modality=Visual, Task-specific training status=MGSD Trained2026.06 | 48.6 | 35.6 | 21.6 | 14.8 | 29.7 | |
| Symbolic-Input Qwen3-VL-4BInput Modality=Symbolic2026.06 | 50.4 | 38.4 | 25.6 | 17.2 | 32.9 | |
| MGSD-8BInput Modality=Visual, Task-specific training status=MGSD Trained2026.06 | 52 | 36 | 28.4 | 18 | 33.6 | |
| Qwen3-VL-32B-ThinkingInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 54.4 | 34 | 19.2 | 17.6 | 31.3 | |
| Kimi-K2.5Input Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 58.4 | 43.6 | 33.6 | 20.4 | 39 | |
| Symbolic-Input Qwen3-VL-8BInput Modality=Symbolic2026.06 | 61.6 | 46 | 31.6 | 29.6 | 42.2 | |
| Gemini-3-FlashInput Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 75.6 | 54.4 | 30 | 16.4 | 44.1 | |
| GPT-5Input Modality=Visual, Prompting Strategy=Prompt-only2026.06 | 77.2 | 44.4 | 26.4 | 16 | 41 |