Mathematical problem solving on MATH-Vision (test)
68.8AccuracyHuman
Evaluation results
| Method | Links | |
|---|---|---|
| Human2025.05 | 68.8 | |
| Claude3.5-Sonnet#Params=-2025.05 | 37.9 | |
| GPT-4o#Params=-2025.05 | 30.4 | |
| GPT-4-turbo#Params=-2025.05 | 30.3 | |
| Claude3-Opus#Params=-2025.05 | 27.1 | |
| MathCoder-VL-8B#Params=8B2025.05 | 26.1 | |
| InternVL2-76B#Params=76B2025.05 | 23.6 | |
| InternVL2-26B#Params=26B2025.05 | 23.1 | |
| GPT-4V#Params=-2025.05 | 22.8 | |
| MathCoder-VL-2B#Params=2B2025.05 | 21.7 | |
| InternVL2-8B#Params=8B2025.05 | 20 | |
| Gemini-1.5-Pro#Params=-2025.05 | 19.2 | |
| Qwen2-VL#Params=8B2025.05 | 19.2 | |
| MathGLM-Vision-9B#Params=9B2025.05 | 19.2 | |
| MAVIS-7B#Params=7B2025.05 | 19.2 | |
| IXC-2.5-Reward#Params=7B2025.05 | 19 | |
| G-LLaVA-7B#Params=7B2025.05 | 16.6 | |
| Multimath-7B#Params=7B2025.05 | 16.3 | |
| Math-LLaVA-13B#Params=13B2025.05 | 15.7 | |
| Qwen-VL-Max#Params=-2025.05 | 15.6 | |
| InternVL-Chat-2B-V1-5#Params=2B2025.05 | 15.3 | |
| IXC-2-VL#Params=7B2025.05 | 14.5 | |
| Math-PUMA-Qwen2#Params=8B2025.05 | 14 | |
| LLaVA-1.5-13B#Params=13B2025.05 | 11 | |
| Qwen-VL-Plus#Params=-2025.05 | 10.8 | |
| Random Chance2025.05 | 7.2 |