Mathematical Reasoning on MathVerse vision-only (testmini)
43AccuracyPLM-HoneyBee-8B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PLM-HoneyBee-8BModel scale=7B-8B2025.10 | 43 | — | |
| PLM-HoneyBee-3BModel scale=3B-4B2025.10 | 42.8 | — | |
| Qwen2.5-VL-7B-InstructModel scale=7B-8B2025.10 | 42 | — | |
| MathFlowPerception Model=MathFlow-P-7B, Inference Model=GPT-4V2025.03 | 39 | 52.5 | |
| InternVL-3-8B-InstructModel scale=7B-8B2025.10 | 35.3 | — | |
| Qwen2.5-VL-3B-InstructModel scale=3B-4B2025.10 | 35 | — | |
| GPT-4V2025.03 | 31.6 | 50.3 | |
| PLM-HoneyBee-1BModel scale=1B2025.10 | 29.4 | — | |
| InternVL-2.5-4BModel scale=3B-4B2025.10 | 28.7 | — | |
| InternVL-2.5-8BModel scale=7B-8B2025.10 | 27.3 | — | |
| Gemini-Pro2025.03 | 22.2 | 33.3 | |
| Qwen-VL-Max2025.03 | 21.4 | 35.9 | |
| PLM-8BModel scale=7B-8B2025.10 | 19.3 | — | |
| InternVL-2.5-1BModel scale=1B2025.10 | 18.7 | — | |
| InternVL-3-1B-InstructModel scale=1B2025.10 | 18 | — | |
| PLM-3BModel scale=3B-4B2025.10 | 18 | — | |
| PLM-1BModel scale=1B2025.10 | 17.8 | — | |
| MathFlowPerception Model=MathFlow-P-7B, Inference Model=Qwen2-VL-72B2025.03 | 17.1 | 24.6 | |
| Qwen2-VL-72B2025.03 | 13.2 | 22.5 | |
| InternLM-XC22025.03 | 11 | 19.8 | |
| Qwen-VL-Plus2025.03 | 10 | 21.8 | |
| SPHINX-MoE2025.03 | 9.1 | 18.3 | |
| InfiMM-Math2025.03 | — | 15.8 | |
| MAVIS-7B2025.03 | — | 14.6 |