List your company
ResearchFormerly WizWand

Multimodal Evaluation on MME (test) (Perception Score)

1,376.2Perception ScoreFirebolt-VL
155.76472.605789.451,106.295Apr 6, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Firebolt-VLLLM=LFM2, Parameters=0.8B2026.041,376.2
LLaVA-PhiLLM=Phi 2, Parameters=2.7B2026.041,335.1
MobileVLM V2LLM=Mobile-LLaMA, Parameters=1.7B2026.041,302.8
MoE-LLaVALLM=Qwen, Parameters=2.2B2026.041,291.6
SmolVLM2LLM=Mobile-LLaMA, Parameters=0.3B2026.041,236.5
MobileVLMLLM=Mobile-LLaMA, Parameters=1.7B2026.041,196.2
IDEFICSLLM=LLaMA, Parameters=9.0B2026.041,177.3
MiniGPT-4-v1LLM=Vicuna, Parameters=8.0B2026.041,047.4
MiniGPT-4-v2LLM=LLaMA 2, Parameters=8.0B2026.04968.4
FastVLLM=Vicuna, Parameters=7.0B2026.04873.2
Kosmos-2LLM=GPT 2, Parameters=1.7B2026.04721.1
OpenFlamingo v2LLM=MPT, Parameters=9.0B2026.04607.2
ChameleonLLM=LLaMA 2, Parameters=7.0B2026.04202.7