Multi-modal Reasoning on M3CoT
82.68AccuracyGemini-3.0-Flash
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini-3.0-FlashStrategy=COCOT, Thinking mode=true2025.07 | 82.68 | — | |
| Gemini-3.0-FlashStrategy=Direct, Thinking mode=true2025.07 | 81.76 | — | |
| OpenAI o1-fullStrategy=COCOT2025.07 | 81.46 | — | |
| OpenAI o1-fullStrategy=Direct2025.07 | 81.4 | — | |
| Gemini-3.0-FlashStrategy=CoT, Thinking mode=true2025.07 | 81.17 | — | |
| GPT-5.2-HighStrategy=COCOT2025.07 | 80.5 | — | |
| GPT-5.2-HighStrategy=Direct2025.07 | 80.02 | — | |
| Gemini-2.5-ProStrategy=COCOT2025.07 | 80 | — | |
| Gemini-2.5-ProStrategy=Direct2025.07 | 78.3 | — | |
| Gemini-2.5-ProStrategy=CoT2025.07 | 76.06 | — | |
| Claude-3.5-SonnetStrategy=COCOT2025.07 | 71 | — | |
| Gemini-3.0-FlashStrategy=CCoT, Thinking mode=true2025.07 | 70.46 | — | |
| GPT-4oStrategy=COCOT2025.07 | 69.22 | — | |
| GPT-5.2-HighStrategy=CoT2025.07 | 68.34 | — | |
| SINKTRACKBase LLM=Qwen2.5-VL-7B-Instruct2026.04 | 66.94 | 79.13 | |
| Gemini-2.5-ProStrategy=CCoT2025.07 | 66.75 | — | |
| OpenAI o1-fullStrategy=CoT2025.07 | 66.25 | — | |
| OpenAI o1-fullStrategy=CCoT2025.07 | 65.32 | — | |
| Claude-3.5-SonnetStrategy=Direct2025.07 | 65.1 | — | |
| GPT-5.2-HighStrategy=CCoT2025.07 | 63 | — | |
| Claude-3.5-SonnetStrategy=CoT2025.07 | 62.82 | — | |
| OpenAI o3-miniStrategy=COCOT2025.07 | 62 | — | |
| SINKTRACKBase LLM=Gemma3-12B-Instruct2026.04 | 60.57 | 70.97 | |
| CoTBase LLM=Gemma3-12B-Instruct2026.04 | 60.32 | 72.24 | |
| OpenAI o3-miniStrategy=Direct2025.07 | 60.15 | — | |
| GPT-4oStrategy=CoT2025.07 | 59.12 | — | |
| GPT-4oStrategy=Direct2025.07 | 57.23 | — | |
| Qwen2-VL-7BStrategy=Direct2025.07 | 56.54 | — | |
| Claude-3.5-SonnetStrategy=CCoT2025.07 | 55.32 | — | |
| Qwen2-VL-7BStrategy=COCOT2025.07 | 54.78 | — | |
| SINKTRACKBase LLM=Gemma3-4B-Instruct2026.04 | 51.01 | 59.18 | |
| CoTBase LLM=Gemma3-4B-Instruct2026.04 | 50.96 | 59.71 | |
| GPT-4oStrategy=CCoT2025.07 | 50 | — | |
| LLaVA-OneVision-7BStrategy=COCOT2025.07 | 50 | — | |
| OpenAI o3-miniStrategy=CoT2025.07 | 48.7 | — | |
| SINKTRACKBase LLM=Qwen2.5-VL-3B-Instruct2026.04 | 48.25 | 58.73 | |
| LLaVA-OneVision-7BStrategy=Direct2025.07 | 48.1 | — | |
| OpenAI o3-miniStrategy=CCoT2025.07 | 46.45 | — | |
| CoTBase LLM=Qwen2.5-VL-7B-Instruct2026.04 | 44.11 | 57.96 | |
| Qwen2-VL-7BStrategy=CCoT2025.07 | 42.08 | — | |
| VRCDDecoding Length=384, Forward Ratio (FR)=0.52026.05 | 41.99 | — | |
| DirectBase LLM=Gemma3-12B-Instruct2026.04 | 41.9 | 51.46 | |
| Qwen2-VL-7BStrategy=CoT2025.07 | 40.72 | — | |
| VRCDDecoding Length=192, Forward Ratio (FR)=0.252026.05 | 40.38 | — | |
| VRCDDecoding Length=384, Forward Ratio (FR)=0.252026.05 | 39.82 | — | |
| VRCDDecoding Length=192, Forward Ratio (FR)=0.52026.05 | 39.6 | — | |
| IGDecoding Length=384, Forward Ratio (FR)=0.52026.05 | 39.23 | — | |
| DirectBase LLM=Qwen2.5-VL-7B-Instruct2026.04 | 39.2 | 51.01 | |
| LLaVA-OneVision-7BStrategy=CoT2025.07 | 38.78 | — | |
| MarginDecoding Length=384, Forward Ratio (FR)=0.52026.05 | 38.47 | — | |
| ConfidenceDecoding Length=384, Forward Ratio (FR)=0.52026.05 | 38.35 | — | |
| MarginDecoding Length=384, Forward Ratio (FR)=0.252026.05 | 38.06 | — | |
| VRCDDecoding Length=192, Forward Ratio (FR)=0.1252026.05 | 37.94 | — | |
| ConfidenceDecoding Length=192, Forward Ratio (FR)=0.252026.05 | 37.68 | — | |
| IGDecoding Length=192, Forward Ratio (FR)=0.252026.05 | 37.39 | — | |
| IGDecoding Length=384, Forward Ratio (FR)=0.252026.05 | 37.26 | — | |
| ConfidenceDecoding Length=384, Forward Ratio (FR)=0.252026.05 | 37.16 | — | |
| MarginDecoding Length=192, Forward Ratio (FR)=0.52026.05 | 36.83 | — | |
| LLaVA-OneVision-7BStrategy=CCoT2025.07 | 36.8 | — | |
| IGDecoding Length=192, Forward Ratio (FR)=0.1252026.05 | 36.66 | — | |
| ConfidenceDecoding Length=192, Forward Ratio (FR)=0.1252026.05 | 36.43 | — | |
| MarginDecoding Length=192, Forward Ratio (FR)=0.252026.05 | 36.2 | — | |
| MarginDecoding Length=192, Forward Ratio (FR)=0.1252026.05 | 35.86 | — | |
| EntropyDecoding Length=384, Forward Ratio (FR)=0.52026.05 | 35.86 | — | |
| ConfidenceDecoding Length=192, Forward Ratio (FR)=0.52026.05 | 34.81 | — | |
| EntropyDecoding Length=384, Forward Ratio (FR)=0.252026.05 | 34.57 | — | |
| IGDecoding Length=192, Forward Ratio (FR)=0.52026.05 | 34.56 | — | |
| VRCDDecoding Length=384, Forward Ratio (FR)=0.1252026.05 | 34.24 | — | |
| MarginDecoding Length=384, Forward Ratio (FR)=0.1252026.05 | 34.11 | — | |
| EntropyDecoding Length=192, Forward Ratio (FR)=0.252026.05 | 33.48 | — | |
| DirectBase LLM=Qwen2.5-VL-3B-Instruct2026.04 | 33.43 | 44.2 | |
| EntropyDecoding Length=192, Forward Ratio (FR)=0.1252026.05 | 32.95 | — | |
| MMaDA+VRCDL=192, FR=0.52026.05 | 29.31 | — | |
| MMaDA+VRCDL=192, FR=0.252026.05 | 29.09 | — | |
| ConfidenceDecoding Length=384, Forward Ratio (FR)=0.1252026.05 | 28.82 | — | |
| IGDecoding Length=384, Forward Ratio (FR)=0.1252026.05 | 28.72 | — | |
| MMaDAL=192, FR=0.52026.05 | 28.42 | — | |
| MMaDA+VRCDL=384, FR=0.252026.05 | 28.24 | — | |
| MMaDA+VRCDL=384, FR=0.52026.05 | 28.03 | — | |
| EntropyDecoding Length=192, Forward Ratio (FR)=0.52026.05 | 27.91 | — | |
| DirectBase LLM=Gemma3-4B-Instruct2026.04 | 27.71 | 33.81 | |
| MMaDAL=192, FR=0.252026.05 | 27.61 | — | |
| MMaDAL=384, FR=0.52026.05 | 26.85 | — | |
| EntropyDecoding Length=384, Forward Ratio (FR)=0.1252026.05 | 26.33 | — | |
| MMaDA+VRCDL=384, FR=0.1252026.05 | 26.19 | — | |
| MMaDA+VRCDL=192, FR=0.1252026.05 | 26.01 | — | |
| MMaDAL=384, FR=0.252026.05 | 25.5 | — | |
| MMaDAL=384, FR=0.1252026.05 | 24.68 | — | |
| MMaDAL=192, FR=0.1252026.05 | 24.42 | — | |
| CoTBase LLM=Qwen2.5-VL-3B-Instruct2026.04 | 20.69 | 32.04 |