List your company

Multimodal Cognitive and Perceptual Evaluation on MME (full)

1,531.3Composite ScoreLLaVA-1.5
543.716800.1081,056.51,312.892Mar 20, 2024

Evaluation results

MethodLinks
LLaVA-1.5LLM=Vicuna-13B, PT=558K, IT=665K2024.031,531.3
LLaVA-1.5LLM=Vicuna-7B, PT=558K, IT=665K2024.031,510.7
Qwen-VL-ChatLLM=Qwen-7B, PT=1.4B, IT=50M2024.031,487.5
VL-MambaLLM=Mamba LLM-2.8B, PT=558K, IT=665K2024.031,369.6
LLaVA-PhiLLM=Phi-2-2.7B, PT=558K, IT=665K2024.031,335.1
BLIP-2LLM=Vicuna-13B, PT=129M2024.031,293.8
OtterLLM=LLaMA-7B2024.031,292.3
MobileVLM-3BLLM=MobileLLaMA-2.7B, PT=558K, IT=665K2024.031,288.9
InstructBLIPLLM=Vicuna-13B, PT=129M, IT=1.2M2024.031,212.8
mPLUG-OwlLLM=LLaMA-7B, PT=2.1M, IT=102K2024.03967.3
MiniGPT-4LLM=Vicuna-7B, PT=5M, IT=5K2024.03581.7