Multi-discipline Multi-modal Understanding on MMMU
3.74CoherenceBase
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BaseBase model=Qwen2.5-VL-7B2026.07 | 3.74 | — | 3.49 | 53 | — | |
| BaseBase model=InternVL3.5-8B2026.07 | 3.72 | — | 3.53 | 74 | — | |
| ReShiftBase model=InternVL3.5-8B2026.07 | 3.67 | 67 | 3.66 | 75 | 9 | |
| ReShiftBase model=Qwen2.5-VL-7B2026.07 | 3.23 | 74 | 3.11 | 52 | 12 | |
| BadVisionBase model=Qwen2.5-VL-7B2026.07 | 2.99 | 27 | 1.77 | 43 | 24 | |
| RewriteBase model=Qwen2.5-VL-7B2026.07 | 2.92 | 55 | 1.29 | 44 | 22 | |
| RewriteBase model=InternVL3.5-8B2026.07 | 2.92 | 50 | 2.67 | 72 | 20 | |
| BadTokenBase model=Qwen2.5-VL-7B2026.07 | 2.53 | 49 | 1.47 | 47 | 27 | |
| BadTokenBase model=InternVL3.5-8B2026.07 | 2.37 | 44 | 2.74 | 70 | 17 | |
| BadVisionBase model=InternVL3.5-8B2026.07 | 2.28 | 19 | 2.93 | 63 | 23 |