Spatial decision-making on FrozenLake size 16
49.38Success RateSpecFlow
Evaluation results
| Method | Links | |
|---|---|---|
| SpecFlowSetting=Flow(image) + AR(Text)2026.06 | 49.38 | |
| Gemini-3-FlashSetting=Naive2026.06 | 46.42 | |
| DiffThinkerSetting=Flow(image) Only2026.06 | 43.62 | |
| GPT-5.1Setting=Naive2026.06 | 42.85 | |
| MVoTSetting=Autoregressive2026.06 | 41.87 | |
| Qwen3-VL-32BSetting=SFT2026.06 | 38.24 | |
| Qwen3-VL-32BSetting=GRPO2026.06 | 35.91 | |
| Qwen3-VL-8BSetting=SFT2026.06 | 29.41 | |
| Qwen3-VL-8BSetting=GRPO2026.06 | 26.98 | |
| Qwen3-VL-32BSetting=Naive2026.06 | 24.58 | |
| Qwen3-VL-8BSetting=Naive2026.06 | 17.21 |