Multimodal Understanding on MMVet turbo
74AccuracyQwen2-VL-72B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2-VL-72BModel Name=Qwen2-VL-72B2024.12 | 74 | |
| InternVL2.5-78BModel Name=InternVL2.5-78B2024.12 | 72.3 | |
| Claude-3.5-SonnetModel Name=Claude-3.5-Sonnet2024.12 | 70.1 | |
| GPT-4o-20240513Model Name=GPT-4o-202405132024.12 | 69.1 | |
| InternVL2.5-38BModel Name=InternVL2.5-38B2024.12 | 68.8 | |
| GPT-4VModel Name=GPT-4V2024.12 | 67.5 | |
| InternVL2-Llama3-76BModel Name=InternVL2-Llama3-76B2024.12 | 65.7 | |
| InternVL2-40BModel Name=InternVL2-40B2024.12 | 65.5 | |
| InternVL2.5-26BModel Name=InternVL2.5-26B2024.12 | 65 | |
| Gemini-1.5-ProModel Name=Gemini-1.5-Pro2024.12 | 64 | |
| InternVL2.5-8BModel Name=InternVL2.5-8B2024.12 | 62.8 | |
| InternVL2-26BModel Name=InternVL2-26B2024.12 | 62.1 | |
| Qwen2-VL-7BModel Name=Qwen2-VL-7B2024.12 | 62 | |
| InternVL-Chat-V1.5Model Name=InternVL-Chat-V1.52024.12 | 61.5 | |
| InternVL2.5-2BModel Name=InternVL2.5-2B2024.12 | 60.8 | |
| InternVL2.5-4BModel Name=InternVL2.5-4B2024.12 | 60.6 | |
| LLaVA-OneVision-72BModel Name=LLaVA-OneVision-72B2024.12 | 60.6 | |
| MiniCPM-V2.6Model Name=MiniCPM-V2.62024.12 | 60 | |
| InternVL2-8BModel Name=InternVL2-8B2024.12 | 54.2 | |
| Cambrian-34BModel Name=Cambrian-34B2024.12 | 53.2 | |
| Claude-3-OpusModel Name=Claude-3-Opus2024.12 | 51.7 | |
| InternVL2-4BModel Name=InternVL2-4B2024.12 | 51 | |
| Qwen2-VL-2BModel Name=Qwen2-VL-2B2024.12 | 49.5 | |
| InternVL2.5-1BModel Name=InternVL2.5-1B2024.12 | 48.8 | |
| Phi-3.5-Vision-4BModel Name=Phi-3.5-Vision-4B2024.12 | 43.2 | |
| InternVL2-2BModel Name=InternVL2-2B2024.12 | 39.5 | |
| InternVL2-1BModel Name=InternVL2-1B2024.12 | 32.7 | |
| LLaVA-OneVision-0.5BModel Name=LLaVA-OneVision-0.5B2024.12 | 32.2 |