Multimodal Reasoning on MathVerse Vision Only
58.76AccuracyInternVL2.5-38B + VRPRM
Evaluation Results
| Method | Links | |
|---|---|---|
| InternVL2.5-38B + VRPRMBase Model=InternVL2.5-38B, Selection Strategy=Best-of-8, Critic Model=VRPRM2025.08 | 58.76 | |
| InternVL2.5-26B + VRPRMBase Model=InternVL2.5-26B, Selection Strategy=Best-of-8, Critic Model=VRPRM2025.08 | 53.55 | |
| InternVL2.5-8B + VRPRMBase Model=InternVL2.5-8B, Selection Strategy=Best-of-8, Critic Model=VRPRM2025.08 | 51.52 | |
| InternVL2.5-38B + VRPRM w/o RLBase Model=InternVL2.5-38B, Selection Strategy=Best-of-8, Critic Model=VRPRM w/o RL2025.08 | 51.52 | |
| Gemini-2.0-FlashSelection Strategy=Standard2025.08 | 47.8 | |
| LUSPOBase model=Qwen2.5-VL-7B-Instruct, Algorithm=LUSPO2026.02 | 47.1 | |
| GRPOBase model=Qwen2.5-VL-7B-Instruct, Algorithm=GRPO2026.02 | 46.8 | |
| InternVL2.5-38B + VisualPRMBase Model=InternVL2.5-38B, Selection Strategy=Best-of-8, Critic Model=VisualPRM2025.08 | 46.7 | |
| Claude-3.5-SonnetSelection Strategy=Standard2025.08 | 46.3 | |
| GSPOBase model=Qwen2.5-VL-7B-Instruct, Algorithm=GSPO2026.02 | 45.6 | |
| InternVL2.5-26B + VRPRM w/o RLBase Model=InternVL2.5-26B, Selection Strategy=Best-of-8, Critic Model=VRPRM w/o RL2025.08 | 44.29 | |
| Qwen2.5-VL-7B-Instruct (w/o RLVR)Base model=Qwen2.5-VL-7B-Instruct, Algorithm=w/o RLVR2026.02 | 41.1 | |
| GPT-4oSelection Strategy=Standard2025.08 | 40.6 | |
| InternVL2.5-8B + VRPRM w/o RLBase Model=InternVL2.5-8B, Selection Strategy=Best-of-8, Critic Model=VRPRM w/o RL2025.08 | 39.85 | |
| InternVL2.5-26B + VisualPRMBase Model=InternVL2.5-26B, Selection Strategy=Best-of-8, Critic Model=VisualPRM2025.08 | 39.1 | |
| InternVL2.5-38BBase Model=InternVL2.5-38B, Selection Strategy=Single-shot2025.08 | 36.9 | |
| InternVL2.5-8B + VisualPRMBase Model=InternVL2.5-8B, Selection Strategy=Best-of-8, Critic Model=VisualPRM2025.08 | 35.8 | |
| InternVL2.5-26BBase Model=InternVL2.5-26B, Selection Strategy=Single-shot2025.08 | 24 | |
| InternVL2.5-8BBase Model=InternVL2.5-8B, Selection Strategy=Single-shot2025.08 | 22.8 |