Multimodal Understanding on MMMU (AUC)
80.89AUC ScoreReLope
Evaluation results
| Method | Links | |
|---|---|---|
| ReLopeBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 80.89 | |
| ReLopeBackbone=Phi-4-Multimodal-Instruct2026.03 | 78.75 | |
| Attention ProbeBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 77.1 | |
| ProbeBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 76.51 | |
| ReLopeBackbone=Gemma3-12B2026.03 | 76.23 | |
| Attention ProbeBackbone=Phi-4-Multimodal-Instruct2026.03 | 72.68 | |
| RouteLLMBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 71.33 | |
| Attention ProbeBackbone=Gemma3-12B2026.03 | 70.39 | |
| Post-Hoc EmbedBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 70.3 | |
| ProbeBackbone=Phi-4-Multimodal-Instruct2026.03 | 69.97 | |
| Cascade RoutingBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 68.32 | |
| ProbeBackbone=Gemma3-12B2026.03 | 68.24 | |
| MoTBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 67.52 | |
| Post-Hoc EmbedBackbone=Phi-4-Multimodal-Instruct2026.03 | 67.28 | |
| RouteLLMBackbone=Phi-4-Multimodal-Instruct2026.03 | 66.12 | |
| Post-Hoc EmbedBackbone=Gemma3-12B2026.03 | 65.68 | |
| RouteLLMBackbone=Gemma3-12B2026.03 | 64.83 | |
| MoTBackbone=Phi-4-Multimodal-Instruct2026.03 | 63.91 | |
| Cascade RoutingBackbone=Phi-4-Multimodal-Instruct2026.03 | 63.79 | |
| Cascade RoutingBackbone=Gemma3-12B2026.03 | 62.52 | |
| MoTBackbone=Gemma3-12B2026.03 | 62.37 |