Spatial decision-making on FrozenLake size 12
64.72Success RateSpecFlow
Evaluation results
| Method | Links | |
|---|---|---|
| SpecFlowSetting=Flow(image) + AR(Text)2026.06 | 64.72 | |
| Gemini-3-FlashSetting=Naive2026.06 | 62.31 | |
| DiffThinkerSetting=Flow(image) Only2026.06 | 60.41 | |
| GPT-5.1Setting=Naive2026.06 | 58.74 | |
| MVoTSetting=Autoregressive2026.06 | 58.62 | |
| Qwen3-VL-32BSetting=SFT2026.06 | 47.36 | |
| Qwen3-VL-32BSetting=GRPO2026.06 | 44.02 | |
| Qwen3-VL-8BSetting=SFT2026.06 | 37.86 | |
| Qwen3-VL-8BSetting=GRPO2026.06 | 34.56 | |
| Qwen3-VL-32BSetting=Naive2026.06 | 33.06 | |
| Qwen3-VL-8BSetting=Naive2026.06 | 22.37 |