Multimodal Understanding on MME Perception (test)
1,696Perception ScoreDense Connector
Evaluation Results
| Method | Links | |
|---|---|---|
| Dense ConnectorPT+IT=1.2M+1.5M, Res.=384 AnyRes, LLM=Yi-34B2024.05 | 1,696 | |
| BAGELParams=14.0B2025.09 | 1,687 | |
| Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Llama3-70B LORA2024.05 | 1,622 | |
| Show-o2-7BParams=7.0B2025.09 | 1,620.5 | |
| ShareGPT4VPT+IT=1.2M+0.7M, Res.=336, LLM=Vicuna-13B2024.05 | 1,619 | |
| Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Yi-34B LORA2024.05 | 1,588 | |
| Dense ConnectorPT+IT=1.2M+1.5M, Res.=384, LLM=Vicuna-13B2024.05 | 1,579 | |
| LLaVA-NeXTPT+IT=0.5M+0.7M, Res.=336 AnyRes, LLM=Vicuna-13B2024.05 | 1,575 | |
| MetaQuery-LParams=3.0B | 3.2B2025.09 | 1,574.3 | |
| DIM-4.6B-T2I/EditParams=3.0B | 1.6B2025.09 | 1,574.3 | |
| Dense ConnectorPT+IT=1.2M+1.5M, Res.=384 AnyRes, LLM=Vicuna-13B2024.05 | 1,573 | |
| VILAPT+IT=50M+1M, Res.=336, LLM=Llama-2-13B2024.05 | 1,570 | |
| Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Vicuna-13B2024.05 | 1,569 | |
| Janus-Pro-7BParams=7.0B2025.09 | 1,567.1 | |
| Mini-GeminiPT+IT=1.2M+1.5M, Res.=336+768, LLM=Vicuna-13B2024.05 | 1,565 | |
| MobileVLM V2PT+IT=1.2M+3.6M, Res.=336, LLM=Vicuna-7B2024.05 | 1,559 | |
| Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Llama3-8B2024.05 | 1,558 | |
| LLaMA-VIDPT+IT=0.8M+0.7M, Res.=336, LLM=Vicuna-7B2024.05 | 1,542 | |
| Dense ConnectorPT+IT=1.2M+1.5M, Res.=384 AnyRes, LLM=Vicuna-7B2024.05 | 1,535 | |
| LLaVA-v1.5PT+IT=0.5M+0.6M, Res.=336, LLM=Vicuna-13B2024.05 | 1,531 | |
| MM1PT+IT=3B+1.4M, Res.=1344, LLM=MM1-7B2024.05 | 1,529 | |
| Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Vicuna-7B2024.05 | 1,523 | |
| LLaVA-LLaMA3PT+IT=0.5M+0.6M, Res.=336, LLM=Llama3-8B2024.05 | 1,506 | |
| Qwen-VL-ChatPT+IT=1.4B+50M, Res.=448, LLM=Qwen-7B2024.05 | 1,488 | |
| Dense ConnectorPT+IT=0.5M+0.6M, Res.=384, LLM=Phi2-2.7B2024.05 | 1,487 | |
| SPHINX-PlusPT+IT=16M, Res.=448, LLM=Llama2-13B2024.05 | 1,458 | |
| mPLUG-Owl2PT+IT=348M+1.2M, Res.=448, LLM=Llama2-7B2024.05 | 1,450 | |
| MobileVLM V2PT+IT=1.2M+3.6M, Res.=336, LLM=ML-2.7B2024.05 | 1,441 | |
| CuMoPT+IT=0.5M+0.6M, Res.=336, LLM=Mistral-7B2024.05 | 1,429 | |
| JanusParams=1.3B2025.09 | 1,338 | |
| Show-oParams=1.3B2025.09 | 1,097.2 |