List your company
ResearchFormerly WizWand

Multimodal Cognition Evaluation on MME Cognition 16

399.5Cognition ScoreLLaVA-1.5+ (Ours)
284.892314.646344.4374.154Jul 5, 2024
Updated 8mo ago

Evaluation results

MethodLinks
LLaVA-1.5+ (Ours)LM=Vicuna(7B), Res.=336, PT=558K, IT=665K2024.07399.5
LAF-7BLM=Vicuna (7B), Res.=336, PT=558K, IT=665K2024.07397.9
Mipha-3B+ (Ours)LM=Phi-2 (2.7B), Res.=384, PT=558K, IT=665K2024.07369.1
Qwen-VL-ChatLM=Qwen (7B), Res.=448, PT=1.4B, IT=50M2024.07360.7
LLaVA-1.5LM=Vicuna (7B), Res.=336, PT=558K, IT=665K2024.07316.1
mPLUG-Owl2LM=LLAMA (7B), Res.=448, PT=400M, IT=1.23M2024.07313.2
Mipha-3BLM=Phi-2 (2.7B), Res.=384, PT=558K, IT=665K2024.07295
InstructBLIPLM=Vicuna (13B), Res.=224, PT=129M, IT=1.2M2024.07291.8
BLIP-2LM=Vicuna (13B), Res.=224, PT=129M, IT=-2024.07290
Bunny-3BLM=Phi-2 (2.7B), Res.=384, PT=2M, IT=695K2024.07289.3