Mathematical Problem Solving on MathVerse (testmini)
64.9AccuracyHuman
Evaluation results
| Method | Links | |
|---|---|---|
| Human2025.05 | 64.9 | |
| Gemini-1.5-Pro#Params=-2025.05 | 51.1 | |
| GPT-4o#Params=-2025.05 | 50.8 | |
| Claude3.5-Sonnet#Params=-2025.05 | 49 | |
| MathCoder-VL-8B#Params=8B2025.05 | 46.5 | |
| MathGLM-Vision-9B#Params=9B2025.05 | 44.2 | |
| GPT-4-turbo#Params=-2025.05 | 43.5 | |
| InternVL2-76B#Params=76B2025.05 | 42.8 | |
| InternVL2-26B#Params=26B2025.05 | 40 | |
| GPT-4V#Params=-2025.05 | 39.4 | |
| Qwen-VL-Max#Params=-2025.05 | 35.9 | |
| InternVL2-8B#Params=8B2025.05 | 35.9 | |
| MathCoder-VL-2B#Params=2B2025.05 | 35.4 | |
| MAVIS-7B#Params=7B2025.05 | 35.2 | |
| Qwen2-VL#Params=8B2025.05 | 33.6 | |
| Math-PUMA-Qwen2#Params=8B2025.05 | 33.6 | |
| Claude3-Opus#Params=-2025.05 | 31.8 | |
| Math-PUMA-DS#Params=7B2025.05 | 31.8 | |
| Multimath-7B#Params=7B2025.05 | 27.7 | |
| IXC-2-VL#Params=7B2025.05 | 25.9 | |
| InternVL-Chat-2B-V1-5#Params=2B2025.05 | 23.1 | |
| Math-LLaVA-13B#Params=13B2025.05 | 22.9 | |
| Qwen-VL-Plus#Params=-2025.05 | 21.3 | |
| Deepseek-VL#Params=8B2025.05 | 19.3 | |
| IXC-2.5-Reward#Params=7B2025.05 | 18.8 | |
| SPHINX-V2-13B#Params=13B2025.05 | 16.1 | |
| LLaVA-1.5-13B#Params=13B2025.05 | 12.7 | |
| Random Chance2025.05 | 12.4 |