Fermi Problem Solving on Fermi
43.51Pass@1 AccuracyChain of Mindset (CoM)
Evaluation results
| Method | Links | |
|---|---|---|
| Chain of Mindset (CoM)Base Model=Qwen3-VL-32B-Instruct2026.02 | 43.51 | |
| CoMBase Model=Gemini-2.0-Flash2026.02 | 43.05 | |
| Chain of Mindset (CoM)Base Model=Gemini-2.0-Flash2026.02 | 43.05 | |
| Zero-shot CoTBase Model=Qwen3-VL-32B-Instruct2026.02 | 42.55 | |
| ReActBase Model=Qwen3-VL-32B-Instruct2026.02 | 42.34 | |
| Direct I/OBase Model=Qwen3-VL-32B-Instruct2026.02 | 42.04 | |
| Zero-shot CoTBase Model=Gemini-2.0-Flash2026.02 | 40.92 | |
| Zero-shot CoTBase Model=Gemini-2.0-Flash2026.02 | 40.92 | |
| MRPBase Model=Qwen3-VL-32B-Instruct2026.02 | 40.82 | |
| Chain of CodeBase Model=Gemini-2.0-Flash2026.02 | 39.8 | |
| Chain of CodeBase Model=Gemini-2.0-Flash2026.02 | 39.8 | |
| Meta-ReasonerBase Model=Qwen3-VL-32B-Instruct2026.02 | 38.67 | |
| Direct I/OBase Model=Gemini-2.0-Flash2026.02 | 38.6 | |
| Direct I/OBase Model=Gemini-2.0-Flash2026.02 | 38.6 | |
| ReActBase Model=Gemini-2.0-Flash2026.02 | 37.91 | |
| ReActBase Model=Gemini-2.0-Flash2026.02 | 37.91 | |
| MRPBase Model=Gemini-2.0-Flash2026.02 | 36.09 | |
| MRPBase Model=Gemini-2.0-Flash2026.02 | 36.09 | |
| Meta-ReasonerBase Model=Gemini-2.0-Flash2026.02 | 25.31 | |
| Meta-ReasonerBase Model=Gemini-2.0-Flash2026.02 | 25.31 | |
| Tree of ThoughtsBase Model=Qwen3-VL-32B-Instruct2026.02 | 24 | |
| Chain of CodeBase Model=Qwen3-VL-32B-Instruct2026.02 | 21.67 | |
| Tree of ThoughtsBase Model=Gemini-2.0-Flash2026.02 | 21.47 | |
| Tree of ThoughtsBase Model=Gemini-2.0-Flash2026.02 | 21.47 |