List your company
ResearchFormerly WizWand

Multimodal Evaluation on MMMU

57.6ScoreVanilla
18.18428.41738.6548.883May 14, 2026
Updated 5mo ago

Evaluation results

MethodLinks
VanillaBackbone=InternVL3.5-8B2026.0557.6
EVABackbone=InternVL3.5-8B2026.0557.6
VanillaBackbone=InternVL3.5-8B2026.0557.6
EVABackbone=InternVL3.5-8B2026.0557.6
VLGuardBackbone=InternVL3.5-8B2026.0557.1
VLGuardBackbone=InternVL3.5-8B2026.0557.1
EVA(text)Backbone=InternVL3.5-8B2026.0557
EVA(text)Backbone=InternVL3.5-8B2026.0557
JailGuardBackbone=InternVL3.5-8B2026.0555.8
JailGuardBackbone=InternVL3.5-8B2026.0555.8
VLGuardBackbone=Qwen2.5-VL-7B2026.0550.2
VLGuardBackbone=Qwen2.5-VL-7B2026.0550.2
VanillaBackbone=Qwen2.5-VL-7B2026.0549.9
VanillaBackbone=Qwen2.5-VL-7B2026.0549.9
EVA(text)Backbone=Qwen2.5-VL-7B2026.0549.6
EVA(text)Backbone=Qwen2.5-VL-7B2026.0549.6
EVABackbone=Qwen2.5-VL-7B2026.0548.2
EVABackbone=Qwen2.5-VL-7B2026.0548.2
JailGuardBackbone=Qwen2.5-VL-7B2026.0547.5
JailGuardBackbone=Qwen2.5-VL-7B2026.0547.5
Adashield-ABackbone=InternVL3.5-8B2026.0538.4
Adashield-ABackbone=InternVL3.5-8B2026.0538.4
Adashield-ABackbone=Qwen2.5-VL-7B2026.0535.4
Adashield-ABackbone=Qwen2.5-VL-7B2026.0535.4
EVABackbone=LLaVA-1.5-7B2026.0533.4
EVABackbone=LLaVA-1.5-7B2026.0533.4
EVA(text)Backbone=LLaVA-1.5-7B2026.0533.3
EVA(text)Backbone=LLaVA-1.5-7B2026.0533.3
VLGuardBackbone=LLaVA-1.5-7B2026.0532.1
VLGuardBackbone=LLaVA-1.5-7B2026.0532.1
VanillaBackbone=LLaVA-1.5-7B2026.0531.3
VanillaBackbone=LLaVA-1.5-7B2026.0531.3
JailGuardBackbone=LLaVA-1.5-7B2026.0529.8
JailGuardBackbone=LLaVA-1.5-7B2026.0529.8
Adashield-ABackbone=LLaVA-1.5-7B2026.0519.7
Adashield-ABackbone=LLaVA-1.5-7B2026.0519.7