Visual Perception on MMBench (T)
79.1Accuracy (MMBench T)MG-LLaVA
Evaluation Results
| Method | Links | |
|---|---|---|
| MG-LLaVALLM=Yi1.5-34B, Params.=34.4B, Res.=336 (768)2024.06 | 79.1 | |
| GPT-4V2024.06 | 77 | |
| MG-LLaVALLM=LLaMA3-8B, Params.=8.4B, Res.=336 (768)2024.06 | 76.6 | |
| GeminiPro Vision2024.06 | 73.6 | |
| MG-LLaVALLM=Vicuna-13B, Params.=13.6B, Res.=336 (768)2024.06 | 73.5 | |
| MG-LLaVALLM=Phi3-3.8B, Params.=4.2B, Res.=336 (768)2024.06 | 72.9 | |
| MG-LLaVALLM=Vicuna-7B, Params.=7.4B, Res.=336 (768)2024.06 | 71.9 | |
| LLaVA-1.5LLM=Vicuna-13B, Params.=13.4B, Res.=3362024.06 | 69.2 | |
| MiniCPM-V2LLM=MiniCPM-2.4B, Params.=2.8B, Res.=4482024.06 | 69.1 | |
| Qwen-VL-Plus2024.06 | 67 | |
| LLaVA-1.5LLM=Vicuna-7B, Params.=7.2B, Res.=3362024.06 | 66.5 | |
| Qwen-VL-ChatLLM=Qwen-7B, Params.=9.6B, Res.=4482024.06 | 61.8 | |
| ShikraLLM=Vicuna-13B, Params.=7.3B, Res.=2242024.06 | 60.2 | |
| IDEFICS-9BLLM=LLaMA-7B, Res.=2242024.06 | 45.3 | |
| Qwen-VLLLM=Qwen-7B, Params.=9.6B, Res.=4482024.06 | 32.2 |