Multimodal Evaluation Collection on OpenCompass
65.1OpenCompass ScoreMiniCPM-Llama3-V 2.5
Evaluation Results
| Method | Links | |
|---|---|---|
| MiniCPM-Llama3-V 2.5Size=8.5B2024.08 | 65.1 | |
| Cambrian-34BSize=34B2024.08 | 64.9 | |
| GPT-4V (2023.11.06)2024.08 | 63.5 | |
| Gemini Pro2024.08 | 62.9 | |
| LLaVA-NeXT-Yi-34BSize=34B2024.08 | 62.7 | |
| CogVLM2-19B-ChatSize=19B2024.08 | 62.3 | |
| Cambrian-8BSize=8.3B2024.08 | 58.8 | |
| Claude 3 Opus2024.08 | 57.7 | |
| Idefics2Size=8.0B2024.08 | 57.2 | |
| DeepSeek-VL-7BSize=7.3B2024.08 | 54.6 | |
| MiniCPM-V 2.0Size=2.8B2024.08 | 54.5 | |
| Bunny-Llama-3-8BSize=8.4B2024.08 | 54.3 | |
| CogVLM-ChatSize=17B2024.08 | 54.2 | |
| XTuner-Llama-3-8B-v1.1Size=8.4B2024.08 | 53.3 | |
| Yi-VL-34BSize=34B2024.08 | 52.2 | |
| Qwen-VL-ChatSize=9.6B2024.08 | 51.6 | |
| Yi-VL-6BSize=6.7B2024.08 | 48.9 | |
| MiniCPM-V 1.0Size=2.8B2024.08 | 47.5 | |
| DeepSeek-VL-1.3BSize=1.7B2024.08 | 46.2 |