Mathematical Reasoning on MathVista F
49AccuracyInternLM-XComposer2
Evaluation results
| Method | Links | |
|---|---|---|
| InternLM-XComposer2Model Category=Open-Source VLMs2024.06 | 49 | |
| InternVL-Chat-v1.5Model Category=Open-Source VLMs2024.06 | 47.5 | |
| GPT-4oModel Category=Proprietary VLMs2024.06 | 46.5 | |
| GPT-4vModel Category=Proprietary VLMs2024.06 | 32 | |
| LLaVA-NeXT (Yi-34B)Model Category=Open-Source VLMs2024.06 | 29.8 | |
| Prism Captioner-7BModel Category=Prism Models, Reasoning Module=Llama32024.06 | 27.3 | |
| MiniCPM-V-2Model Category=Open-Source VLMs2024.06 | 25.4 | |
| Prism Captioner-7BModel Category=Prism Models, Reasoning Module=ChatGPT2024.06 | 24.6 | |
| LLaVA-NeXT (Mistral-7B)Model Category=Open-Source VLMs2024.06 | 21.3 | |
| DeepSeek-VL-7BModel Category=Open-Source VLMs2024.06 | 20.7 | |
| Prism Captioner-2BModel Category=Prism Models, Reasoning Module=Llama32024.06 | 19.8 | |
| LLaVA-NeXT (Vicuna-13B)Model Category=Open-Source VLMs2024.06 | 19.6 | |
| Prism Captioner-2BModel Category=Prism Models, Reasoning Module=ChatGPT2024.06 | 18.2 | |
| LLaVA-NeXT (Vicuna-7B)Model Category=Open-Source VLMs2024.06 | 17.1 | |
| Emu2-ChatModel Category=Open-Source VLMs2024.06 | 14 | |
| ShareCaptionerModel Category=Prism Models, Reasoning Module=ChatGPT2024.06 | 12.6 | |
| Yi-VL-34BModel Category=Open-Source VLMs2024.06 | 12 | |
| LLaVA-v1.5-13BModel Category=Open-Source VLMs2024.06 | 10.3 | |
| LLaVA-InternLM2-20BModel Category=Open-Source VLMs2024.06 | 9.9 | |
| LLaVA-InternLM2-1.8BModel Category=Open-Source VLMs (E2E Baselines)2024.06 | 9.1 | |
| LLaVA-v1.5-7BModel Category=Open-Source VLMs2024.06 | 8.5 | |
| mPLUG-Owl2Model Category=Open-Source VLMs2024.06 | 8.5 | |
| LLaVA-InternLM2-7BModel Category=Open-Source VLMs (E2E Baselines)2024.06 | 7.4 |