Spatial decision-making on Maze, MiniBehavior, and FrozenLake Average
79.15Success Rate (%)SpecFlow
Evaluation Results
| Method | Links | |
|---|---|---|
| SpecFlowSetting=Flow(image) + AR(Text)2026.06 | 79.15 | |
| Gemini-3-FlashSetting=Naive2026.06 | 77.67 | |
| DiffThinkerSetting=Flow(image) Only2026.06 | 75.59 | |
| GPT-5.1Setting=Naive2026.06 | 74.53 | |
| MVoTSetting=Autoregressive2026.06 | 74.1 | |
| Qwen3-VL-32BSetting=SFT2026.06 | 63.27 | |
| Qwen3-VL-32BSetting=GRPO2026.06 | 59.83 | |
| Qwen3-VL-8BSetting=SFT2026.06 | 54.25 | |
| Qwen3-VL-8BSetting=GRPO2026.06 | 50.73 | |
| Qwen3-VL-32BSetting=Naive2026.06 | 48.02 | |
| Qwen3-VL-8BSetting=Naive2026.06 | 38.11 |