List your company
ResearchFormerly WizWand

Perception Evaluation on MME Perception

1,755.5ScoreSAP
1,270.2361,396.2181,522.21,648.182Dec 12, 2024Feb 22, 2025May 5, 2025Jul 16, 2025Sep 26, 2025Dec 7, 2025Feb 18, 2026
Updated 7mo ago

Evaluation results

MethodLinks
SAPBackbone=Qwen3-VL-8B, Strategy=SAP2026.021,755.5
Qwen3-VL-8B-InstructBackbone=Qwen3-VL-8B, Strategy=Instruct2026.021,744.7
VGAMLLM=Qwen2.5-VL-7B2025.111,719.7
TARACMLLM=Qwen2.5-VL-7B2025.111,713.1
VanillaMLLM=Qwen2.5-VL-7B2025.111,691.1
Qwen3-VL-8B-ThinkingBackbone=Qwen3-VL-8B, Strategy=LongCoT (Thinking)2026.021,663.2
OlympusLM=Phi-2-2.7B, Res.=3842024.121,520.7
LLaVA-1.5LM=Vicuna-7B, Res.=3362024.121,510.7
Mipha-3BLM=Phi-2-2.7B, Res.=3842024.121,488.9
Bunny-3BLM=Phi-2-2.7B, Res.=3842024.121,488.8
Qwen-VL-ChatLM=Qwen-7B, Res.=4482024.121,487.5
VGAMLLM=LLaVA-1.5-7B2025.111,465.7
TinyLLaVALM=Phi-2-2.7B, Res.=3842024.121,464.9
TARACMLLM=LLaVA-1.5-7B2025.111,462.1
VanillaMLLM=LLaVA-1.5-7B2025.111,456.5
mPLUG-Owl2LM=LLaMA-7B, Res.=4482024.121,450.2
MobileVLM-v2-3BLM=MobileLLaMA-2.7B, Res.=3362024.121,440.5
Imp-v1LM=Phi-2-2.7B, Res.=3842024.121,434
MoE-LLaVA-3.6BLM=Phi-2-2.7B, Res.=3842024.121,431.3
LLaVA-PhiLM=Phi-2-2.7B, Res.=3362024.121,335.1
MobileVLM-3BLM=MobileLLaMA-2.7B, Res.=3362024.121,288.9