Multi-discipline Multimodal Understanding on MMMU F
45.9AccuracyGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oModel Category=Proprietary VLMs2024.06 | 45.9 | |
| GPT-4vModel Category=Proprietary VLMs2024.06 | 42 | |
| Prism Captioner-7BModel Category=Prism Models, Reasoning Module=Llama32024.06 | 35.6 | |
| InternVL-Chat-v1.5Model Category=Open-Source VLMs2024.06 | 33.7 | |
| Prism Captioner-2BModel Category=Prism Models, Reasoning Module=Llama32024.06 | 32.4 | |
| Prism Captioner-2BModel Category=Prism Models, Reasoning Module=ChatGPT2024.06 | 32 | |
| ShareCaptionerModel Category=Prism Models, Reasoning Module=ChatGPT2024.06 | 30.2 | |
| Prism Captioner-7BModel Category=Prism Models, Reasoning Module=ChatGPT2024.06 | 29.8 | |
| Emu2-ChatModel Category=Open-Source VLMs2024.06 | 27.8 | |
| LLaVA-NeXT (Yi-34B)Model Category=Open-Source VLMs2024.06 | 26.7 | |
| LLaVA-InternLM2-7BModel Category=Open-Source VLMs (E2E Baselines)2024.06 | 21.9 | |
| InternLM-XComposer2Model Category=Open-Source VLMs2024.06 | 21.2 | |
| Yi-VL-34BModel Category=Open-Source VLMs2024.06 | 21.2 | |
| MiniCPM-V-2Model Category=Open-Source VLMs2024.06 | 21.2 | |
| DeepSeek-VL-7BModel Category=Open-Source VLMs2024.06 | 19.6 | |
| mPLUG-Owl2Model Category=Open-Source VLMs2024.06 | 19.6 | |
| LLaVA-NeXT (Mistral-7B)Model Category=Open-Source VLMs2024.06 | 19.2 | |
| LLaVA-InternLM2-1.8BModel Category=Open-Source VLMs (E2E Baselines)2024.06 | 18.4 | |
| LLaVA-NeXT (Vicuna-7B)Model Category=Open-Source VLMs2024.06 | 18 | |
| LLaVA-InternLM2-20BModel Category=Open-Source VLMs2024.06 | 18 | |
| LLaVA-NeXT (Vicuna-13B)Model Category=Open-Source VLMs2024.06 | 16.5 | |
| LLaVA-v1.5-7BModel Category=Open-Source VLMs2024.06 | 15.7 | |
| LLaVA-v1.5-13BModel Category=Open-Source VLMs2024.06 | 15.3 |