List your company
ResearchFormerly WizWand

Multimodal Understanding on MME Perception (test)

1,696Perception ScoreDense Connector
1,073.2481,234.9241,396.61,558.276May 22, 2024Aug 8, 2024Oct 25, 2024Jan 11, 2025Mar 30, 2025Jun 16, 2025Sep 2, 2025
Updated 6mo ago

Evaluation results

MethodLinks
Dense ConnectorPT+IT=1.2M+1.5M, Res.=384 AnyRes, LLM=Yi-34B2024.051,696
BAGELParams=14.0B2025.091,687
Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Llama3-70B LORA2024.051,622
Show-o2-7BParams=7.0B2025.091,620.5
ShareGPT4VPT+IT=1.2M+0.7M, Res.=336, LLM=Vicuna-13B2024.051,619
Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Yi-34B LORA2024.051,588
Dense ConnectorPT+IT=1.2M+1.5M, Res.=384, LLM=Vicuna-13B2024.051,579
LLaVA-NeXTPT+IT=0.5M+0.7M, Res.=336 AnyRes, LLM=Vicuna-13B2024.051,575
MetaQuery-LParams=3.0B | 3.2B2025.091,574.3
DIM-4.6B-T2I/EditParams=3.0B | 1.6B2025.091,574.3
Dense ConnectorPT+IT=1.2M+1.5M, Res.=384 AnyRes, LLM=Vicuna-13B2024.051,573
VILAPT+IT=50M+1M, Res.=336, LLM=Llama-2-13B2024.051,570
Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Vicuna-13B2024.051,569
Janus-Pro-7BParams=7.0B2025.091,567.1
Mini-GeminiPT+IT=1.2M+1.5M, Res.=336+768, LLM=Vicuna-13B2024.051,565
MobileVLM V2PT+IT=1.2M+3.6M, Res.=336, LLM=Vicuna-7B2024.051,559
Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Llama3-8B2024.051,558
LLaMA-VIDPT+IT=0.8M+0.7M, Res.=336, LLM=Vicuna-7B2024.051,542
Dense ConnectorPT+IT=1.2M+1.5M, Res.=384 AnyRes, LLM=Vicuna-7B2024.051,535
LLaVA-v1.5PT+IT=0.5M+0.6M, Res.=336, LLM=Vicuna-13B2024.051,531
MM1PT+IT=3B+1.4M, Res.=1344, LLM=MM1-7B2024.051,529
Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Vicuna-7B2024.051,523
LLaVA-LLaMA3PT+IT=0.5M+0.6M, Res.=336, LLM=Llama3-8B2024.051,506
Qwen-VL-ChatPT+IT=1.4B+50M, Res.=448, LLM=Qwen-7B2024.051,488
Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Phi2-2.7B2024.051,487
SPHINX-PlusPT+IT=16M, Res.=448, LLM=Llama2-13B2024.051,458
mPLUG-Owl2PT+IT=348M+1.2M, Res.=448, LLM=Llama2-7B2024.051,450
MobileVLM V2PT+IT=1.2M+3.6M, Res.=336, LLM=ML-2.7B2024.051,441
CuMoPT+IT=0.5M+0.6M, Res.=336, LLM=Mistral-7B2024.051,429
JanusParams=1.3B2025.091,338
Show-oParams=1.3B2025.091,097.2