List your company

Visual Perception Evaluation on MME Perception

1,714Perception ScoreMoAI
536.72842.361,1481,453.64Oct 5, 2023Oct 31, 2023Nov 27, 2023Dec 23, 2023Jan 19, 2024Feb 14, 2024Mar 12, 2024

Evaluation results

MethodLinks
MoAIZero-shot=true, Number of Parameters=7B2024.031,714
ShareGPT4VZero-shot=true, Number of Parameters=7B2024.031,567
LLaVA-1.5-13BLLM=Vicuna-13B, Image Size=336x336, Pre-train Sample Size=558K, Fine-tune Sample Size=665K2023.101,531.3
LLaVA1.5Zero-shot=true, Number of Parameters=13B2024.031,531
Intern-XCZero-shot=true, Number of Parameters=7B2024.031,528
LLaVA1.5Zero-shot=true, Number of Parameters=7B2024.031,511
LLaVA-1.5-7BLLM=Vicuna-7B, Image Size=336x336, Pre-train Sample Size=558K, Fine-tune Sample Size=665K2023.101,510.7
LLaVA-1.5-13B-HDLLM=Vicuna-13B, Image Size=448x448, Pre-train Sample Size=558K, Fine-tune Sample Size=665K2023.101,500.1
Qwen-VL-ChatZero-shot=true, Number of Parameters=7B2024.031,488
Qwen-VL-ChatLLM=Qwen-7B, Image Size=448x448, Pre-train Sample Size=1.4B*, Fine-tune Sample Size=50M+2023.101,487.5
mPLUG-Owl2Zero-shot=true, Number of Parameters=7B2024.031,450
BLIP2Zero-shot=true, Number of Parameters=13B2024.031,294
BLIP2-14BLLM=Vicuna-13B, Image Size=224x224, Pre-train Sample Size=129M2023.101,293.8
OtterZero-shot=true, Number of Parameters=7B2024.031,292
InstructBLIPZero-shot=true, Number of Parameters=13B2024.031,213
InstructBLIP-14BLLM=Vicuna-13B, Image Size=224x224, Pre-train Sample Size=129M, Fine-tune Sample Size=1.2M2023.101,212.8
mPLUG-OwlZero-shot=true, Number of Parameters=7B2024.03967
LLaVA-7BLLM=Vicuna-7B2023.10809.6
LLaVAZero-shot=true, Number of Parameters=7B2024.03807
MiniGPT-4Zero-shot=true, Number of Parameters=7B2024.03582