Question Answering on GridWorld (full)
95AccuracyMindZero
Evaluation Results
| Method | Links | |
|---|---|---|
| MindZeroBase Model=Qwen3-VL-4B, TFLOPs=3.62026.05 | 95 | |
| MindZeroBase Model=Qwen3-VL-8B, TFLOPs=7.22026.05 | 92.3 | |
| Gemini-3-ProTFLOPs=Proprietary2026.05 | 83.7 | |
| Gemini-3-FlashTFLOPs=Proprietary2026.05 | 68 | |
| ThoughtTracingBase Model=Gemini-3-Flash, TFLOPs=Proprietary, Input Modality=Text-only2026.05 | 64 | |
| ThoughtTracingBase Model=GPT-5.2, TFLOPs=Proprietary, Input Modality=Text-only2026.05 | 57.3 | |
| AutoToMBase Model=GPT-5.2, TFLOPs=Proprietary, Input Modality=Text-only2026.05 | 57.3 | |
| ThoughtTracingBase Model=Qwen3-VL-8B, TFLOPs=54.3, Input Modality=Text-only2026.05 | 56.7 | |
| ThoughtTracingBase Model=Qwen3-VL-235B-A22B, TFLOPs=169.8, Input Modality=Text-only2026.05 | 53 | |
| AutoToMBase Model=Qwen3-VL-8B, TFLOPs=741.2, Input Modality=Text-only2026.05 | 52.3 | |
| GPT-5.2TFLOPs=Proprietary, Think mode=false2026.05 | 50.7 | |
| GPT-5.2TFLOPs=Proprietary, Think mode=true2026.05 | 50.7 | |
| ThoughtTracingBase Model=Qwen3-VL-4B, TFLOPs=31.0, Input Modality=Text-only2026.05 | 50.3 | |
| AutoToMBase Model=Qwen3-VL-4B, TFLOPs=344.4, Input Modality=Text-only2026.05 | 49.3 | |
| AutoToMBase Model=Gemini-3-Flash, TFLOPs=Proprietary, Input Modality=Text-only2026.05 | 47 | |
| Qwen3-VL-8BTFLOPs=110.9, Think mode=true2026.05 | 44.7 | |
| AutoToMBase Model=Qwen3-VL-235B-A22B, TFLOPs=1089.7, Input Modality=Text-only2026.05 | 44.7 | |
| Qwen3-VL-235B-A22BTFLOPs=1767.5, Think mode=true2026.05 | 44.3 | |
| Qwen3-VL-8BTFLOPs=7.2, Think mode=false2026.05 | 43.3 | |
| Qwen3-VL-4BTFLOPs=67.1, Think mode=true2026.05 | 42.7 | |
| Qwen3-VL-235B-A22BTFLOPs=21.9, Think mode=false2026.05 | 39.3 | |
| Qwen3-VL-4BTFLOPs=3.6, Think mode=false2026.05 | 37.7 |