Multi-step Reasoning on ScienceQA
92.72AccuracySceneAlign
Evaluation results
| Method | Links | |
|---|---|---|
| SceneAlignModel=Qwen3-VL-4B2026.01 | 92.72 | |
| RFTBackbone=Llama-3.1-8B-Instruct, Setting=zero-shot2026.03 | 92.4 | |
| self-rewardingBackbone=Llama-3.1-8B-Instruct, Setting=zero-shot2026.03 | 92.2 | |
| CoTBackbone=Llama-3.1-8B-Instruct, Setting=four-shot2026.03 | 91.9 | |
| ORACLEBackbone=Llama-3.1-8B-Instruct, Setting=zero-shot2026.03 | 91.7 | |
| SFTModel=Qwen3-VL-4B2026.01 | 91.53 | |
| BaseModel=Qwen3-VL-4B2026.01 | 91.49 | |
| BaseModel=InternVL3-8B2026.01 | 90.77 | |
| ToT-SFTBackbone=Llama-3.1-8B-Instruct, Setting=zero-shot2026.03 | 90.7 | |
| CoTBackbone=Llama-3.1-8B-Instruct, Setting=zero-shot2026.03 | 90.5 | |
| SceneAlignModel=InternVL3-8B2026.01 | 90.15 | |
| SFTModel=InternVL3-8B2026.01 | 90.02 | |
| SceneAlignModel=Qwen2.5-VL-7B2026.01 | 89.12 | |
| SFTModel=Qwen2.5-VL-7B2026.01 | 88.8 | |
| BaseModel=Qwen2.5-VL-7B2026.01 | 88.71 | |
| ORACLEBackbone=Qwen-2.5-7B-instruct, Setting=zero-shot2026.03 | 87.3 | |
| RFTBackbone=Qwen-2.5-7B-instruct, Setting=zero-shot2026.03 | 86.3 | |
| SceneAlignModel=Qwen2.5-VL-3B2026.01 | 85.1 | |
| CoTBackbone=Qwen-2.5-7B-instruct, Setting=four-shot2026.03 | 84.9 | |
| ORACLEBackbone=Mistral-7B-Instruct-v0.3, Setting=zero-shot2026.03 | 83.3 | |
| SFTModel=Qwen2.5-VL-3B2026.01 | 83.26 | |
| SceneAlignModel=LLaVA-Next-8B2026.01 | 83.25 | |
| BaseModel=Qwen2.5-VL-3B2026.01 | 83.19 | |
| ToT-SFTBackbone=Qwen-2.5-7B-instruct, Setting=zero-shot2026.03 | 82.9 | |
| CoTBackbone=Qwen-2.5-7B-instruct, Setting=zero-shot2026.03 | 82.6 | |
| self-rewardingBackbone=Qwen-2.5-7B-instruct, Setting=zero-shot2026.03 | 82.5 | |
| SFTModel=LLaVA-Next-8B2026.01 | 81.99 | |
| AoTModel=LLaVA-Next-8B2026.01 | 81.25 | |
| LLaVA-ReasonerModel=LLaVA-Next-8B2026.01 | 81.1 | |
| RFTBackbone=Mistral-7B-Instruct-v0.3, Setting=zero-shot2026.03 | 81 | |
| self-rewardingBackbone=Mistral-7B-Instruct-v0.3, Setting=zero-shot2026.03 | 80.2 | |
| BaseModel=LLaVA-Next-8B2026.01 | 80.12 | |
| ToT-SFTBackbone=Mistral-7B-Instruct-v0.3, Setting=zero-shot2026.03 | 77.4 | |
| CoTBackbone=Mistral-7B-Instruct-v0.3, Setting=four-shot2026.03 | 77 | |
| CoTBackbone=Mistral-7B-Instruct-v0.3, Setting=zero-shot2026.03 | 75.3 |