Multimodal Reasoning on MMMU (test)
64.7AccuracyGPT-4o
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-4oSize=—2026.01 | 64.7 | |
| InternVL2.5-78Bparameters=78B2024.12 | 61.8 | |
| Qwen2.5-VL-DPParameters=7B, Post-training Strategy=Direct Preference (DP)2025.07 | 59.4 | |
| Qwen2.5-VL-7BParameters=7B2025.07 | 58.6 | |
| InternVL2.5-38Bparameters=38B2024.12 | 57.6 | |
| InternVL2-Llama3-76Bparameters=76B, backbone=Llama32024.12 | 55.1 | |
| NVLM-D-72Bparameters=72B2024.12 | 54.6 | |
| InternVL2.5-26Bparameters=26B2024.12 | 51.8 | |
| Full Prec2025.08 | 50.44 | |
| Qwen2-VL-DPParameters=7B, Post-training Strategy=Direct Preference (DP)2025.07 | 49.4 | |
| InternVL2-40Bparameters=40B2024.12 | 49.3 | |
| InternVL2.5-8Bparameters=8B2024.12 | 48.9 | |
| Qwen2-VL-7BParameters=7B2025.07 | 47.8 | |
| VILA-1.5-40Bparameters=40B2024.12 | 46.9 | |
| Qwen2-VLSize=8B2026.01 | 46.6 | |
| InternVL2.5-4Bparameters=4B2024.12 | 46.3 | |
| LinMU-NVSize=8B2026.01 | 44.6 | |
| NVILASize=8B2026.01 | 44.4 | |
| InternVL2-8Bparameters=8B2024.12 | 44.3 | |
| InternVL2-26Bparameters=26B2024.12 | 43.8 | |
| LLaVA-OVSize=7B2026.01 | 42.8 | |
| InternVL2Size=8B2026.01 | 42.6 | |
| InternVL2-4Bparameters=4B2024.12 | 41.4 | |
| InternVL-Chat-V1.52024.12 | 41 | |
| InternVL2.5-2Bparameters=2B2024.12 | 38.2 | |
| LLaVA-1.5Parameters=13B2025.07 | 36.4 | |
| InternVL2.5-1Bparameters=1B2024.12 | 35.8 | |
| InternVL2-2Bparameters=2B2024.12 | 34.7 | |
| VLMQ2025.08 | 33.67 | |
| SPHINXParameters=13B2025.07 | 32.9 | |
| InstructBLIPParameters=7B2025.07 | 32.9 | |
| InternVL2-1Bparameters=1B2024.12 | 32.8 | |
| GPTQ2025.08 | 32.22 | |
| EntropyPruneRetained Tokens=320 (↓ 88.9%)2026.02 | 30 | |
| FastVRetained Tokens=320 (↓ 88.9%)2026.02 | 29.3 | |
| LLaVA-Next-7BRetained Tokens=2880 (100%)2026.02 | 28 | |
| PDropRetained Tokens=320 (↓ 88.9%)2026.02 | 27.3 | |
| CDPrunerRetained Tokens=320 (↓ 88.9%)2026.02 | 27.3 | |
| Frequent Guess2025.07 | 26.8 | |
| DARTRetained Tokens=320 (↓ 88.9%)2026.02 | 26.7 | |
| DivPruneRetained Tokens=320 (↓ 88.9%)2026.02 | 25.3 | |
| GPTAQ2025.08 | 22.25 | |
| Random Chance2025.07 | 22.1 |