Multimodal Reasoning on MathVerse (testmini)
57.6Mean@1 AccuracyQwen2.5-VL-72B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2.5-VL-72BModel Category=General Multimodal LLM, Parameters=72B2025.12 | 57.6 | |
| SRPO-7BModel Category=Reasoning Multimodal LLM, Parameters=7B2025.12 | 55.8 | |
| ReLaX-VL-7BModel Category=Reasoning Multimodal LLM, Parameters=7B2025.12 | 55.7 | |
| VL-Rethinker-7BModel Category=Reasoning Multimodal LLM, Parameters=7B2025.12 | 54.2 | |
| Vision-R1-7BModel Category=Reasoning Multimodal LLM, Parameters=7B2025.12 | 52.4 | |
| MM-Eureka-7BModel Category=Reasoning Multimodal LLM, Parameters=7B2025.12 | 50.3 | |
| Qwen2.5-VL-7BModel Category=General Multimodal LLM, Parameters=7B2025.12 | 49.2 | |
| OpenVLThinker-7BModel Category=Reasoning Multimodal LLM, Parameters=7B2025.12 | 47.9 | |
| ReLaX-VL-3BModel Category=Reasoning Multimodal LLM, Parameters=3B2025.12 | 46.2 | |
| Kimi-VL-16BModel Category=General Multimodal LLM, Parameters=16B2025.12 | 44.9 | |
| MM-Eureka-8BModel Category=Reasoning Multimodal LLM, Parameters=8B2025.12 | 40.4 | |
| R1-VL-7BModel Category=Reasoning Multimodal LLM, Parameters=7B2025.12 | 40 | |
| Intern2.5-VL-8BModel Category=General Multimodal LLM, Parameters=8B2025.12 | 39.5 | |
| Qwen2.5-VL-3BModel Category=General Multimodal LLM, Parameters=3B, reproduced=true2025.12 | 33.5 | |
| Llava-OV-7BModel Category=General Multimodal LLM, Parameters=7B2025.12 | 26.2 | |
| Intern2-VL-8BModel Category=General Multimodal LLM, Parameters=8B2025.12 | 22.8 | |
| Qwen2-VL-7BModel Category=General Multimodal LLM, Parameters=7B2025.12 | 19.7 |