Spatial decision-making on FrozenLake size 4
87.94Success RateSpecFlow
Evaluation results
| Method | Links | |
|---|---|---|
| SpecFlowSetting=Flow(image) + AR(Text)2026.06 | 87.94 | |
| Gemini-3-FlashSetting=Naive2026.06 | 86.58 | |
| DiffThinkerSetting=Flow(image) Only2026.06 | 84.96 | |
| MVoTSetting=Autoregressive2026.06 | 83.31 | |
| GPT-5.1Setting=Naive2026.06 | 83.27 | |
| Qwen3-VL-32BSetting=SFT2026.06 | 79.58 | |
| Qwen3-VL-32BSetting=GRPO2026.06 | 76.43 | |
| Qwen3-VL-8BSetting=SFT2026.06 | 71.46 | |
| Qwen3-VL-8BSetting=GRPO2026.06 | 68.02 | |
| Qwen3-VL-32BSetting=Naive2026.06 | 65.47 | |
| Qwen3-VL-8BSetting=Naive2026.06 | 55.21 |