Multimodal Understanding on MMMU (Accuracy, Rel. (%))
54.1AccuracyFull Model
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Full ModelBackbone=Qwen2-VL-7B, Sparsity Ratio=0%2026.04 | 54.1 | 100 | |
| TopoVLMBackbone=Qwen2-VL-7B, Sparsity Ratio=50%2026.04 | 52.8 | 95.4 | |
| TAMPBackbone=Qwen2-VL-7B, Sparsity Ratio=50%2026.04 | 51.4 | 93.2 | |
| ReGapModel=Qwen3-Omni-30B-A3B-Instruct2026.05 | 50.6 | — | |
| WandaBackbone=Qwen2-VL-7B, Sparsity Ratio=50%2026.04 | 50.2 | 89.3 | |
| BaseModel=Qwen3-Omni-30B-A3B-Instruct2026.05 | 50 | — | |
| LLM-StreamlineBackbone=Qwen2-VL-7B, Sparsity Ratio=50%2026.04 | 49.8 | 91.2 | |
| ECoFLaPBackbone=Qwen2-VL-7B, Sparsity Ratio=50%2026.04 | 49.5 | 90.5 | |
| SparseGPTBackbone=Qwen2-VL-7B, Sparsity Ratio=50%2026.04 | 48.9 | 90.1 | |
| OWLBackbone=Qwen2-VL-7B, Sparsity Ratio=50%2026.04 | 48.3 | 88.4 | |
| LLM-PrunerBackbone=Qwen2-VL-7B, Sparsity Ratio=50%2026.04 | 47.6 | 88.6 | |
| ReGapModel=MiniCPM-o-4.52026.05 | 45.4 | — | |
| BaseModel=MiniCPM-o-4.52026.05 | 43.4 | — | |
| DiM3Model Size=7B2026.05 | 37.22 | — | |
| LLaVA-CKDLLM=Qwen2.5-1.5B, #TS=1.2M2026.05 | 36.9 | — | |
| Task Arithmetic2026.05 | 36.89 | — | |
| NeuroMerging2026.05 | 36.89 | — | |
| LLaVA-v1.5Model Size=7B2026.05 | 36.33 | — | |
| TIES-Merging2026.05 | 36.33 | — | |
| DARE2026.05 | 35.78 | — | |
| LLaVA-MORELLM=Gemma-2-2B, #TS=1.2M2026.05 | 33.4 | — | |
| Breadcrumbs2026.05 | 33.33 | — | |
| ALLaVALLM=StableLM-2-1.6B, #TS=1.2M2026.05 | 33.3 | — | |
| PaloModel Size=7B2026.05 | 33.11 | — | |
| LLaVA-CKDLLM=Qwen2.5-0.5B, #TS=1.2M2026.05 | 32.8 | — | |
| MiniGeminiLLM=Gemma-2B, #TS=2.2M2026.05 | 31.7 | — | |
| EM-KDLLM=Qwen2.5-0.5B, #TS=1.3M2026.05 | 31 | — | |
| STF2026.05 | 30.67 | — | |
| LVIDALLM=Llama-3.2-1B, #TS=1.2M2026.05 | 29.9 | — | |
| Refusal SteeringModel=Qwen3-Omni-30B-A3B-Instruct2026.05 | 25.6 | — | |
| ReGapModel=Qwen2.5-Omni-3B2026.05 | 25.4 | — | |
| BaseModel=Qwen2.5-Omni-3B2026.05 | 25 | — | |
| Refusal SteeringModel=MiniCPM-o-4.52026.05 | 16.2 | — | |
| Refusal SteeringModel=Qwen2.5-Omni-3B2026.05 | 9.2 | — |