Step-wise Verification on MMMU
59.2Macro F1Qwen2.5-VL
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2.5-VLModel Type=Open-source, Number of Parameters=72B2025.11 | 59.2 | |
| Gemini-2.0-FlashModel Type=Proprietary2025.11 | 58.5 | |
| TIM-PRMModel Type=Open-source, Number of Parameters=8B2025.11 | 58.3 | |
| Qwen3-VLModel Type=Open-source, Number of Parameters=8B2025.11 | 56.6 | |
| GPT-4oModel Type=Proprietary2025.11 | 56.3 | |
| TIM-PRMModel Type=Open-source, Number of Parameters=2B2025.11 | 55.8 | |
| VisualPRMModel Type=Open-source, Number of Parameters=8B2025.11 | 54.9 | |
| GPT-4o-MiniModel Type=Proprietary2025.11 | 53.6 | |
| Qwen2.5-VLModel Type=Open-source, Number of Parameters=7B2025.11 | 53.1 | |
| InternVL2.5Model Type=Open-source, Number of Parameters=78B2025.11 | 52 | |
| InternVL2.5Model Type=Open-source, Number of Parameters=38B2025.11 | 51.5 | |
| MM-PRMModel Type=Open-source, Number of Parameters=8B2025.11 | 51.2 | |
| Qwen3-VLModel Type=Open-source, Number of Parameters=2B2025.11 | 50.4 | |
| InternVL2.5Model Type=Open-source, Number of Parameters=26B2025.11 | 48.8 | |
| InternVL2.5Model Type=Open-source, Number of Parameters=8B2025.11 | 47.1 | |
| LLaVA-OVModel Type=Open-source, Number of Parameters=72B2025.11 | 46.1 | |
| LLaVA-OVModel Type=Open-source, Number of Parameters=7B2025.11 | 45.7 | |
| MiniCPM-V2.6Model Type=Open-source, Number of Parameters=8B2025.11 | 44.9 |