Multimodal Understanding on MMVet v2 (0613)
71.8AccuracyClaude-3.5-Sonnet
Evaluation Results
| Method | Links | |
|---|---|---|
| Claude-3.5-SonnetModel Name=Claude-3.5-Sonnet2024.12 | 71.8 | |
| GPT-4o-20240513Model Name=GPT-4o-202405132024.12 | 71 | |
| InternVL2-Llama3-76BModel Name=InternVL2-Llama3-76B2024.12 | 68.4 | |
| Gemini-1.5-ProModel Name=Gemini-1.5-Pro2024.12 | 66.9 | |
| Qwen2-VL-72BModel Name=Qwen2-VL-72B2024.12 | 66.9 | |
| GPT-4VModel Name=GPT-4V2024.12 | 66.3 | |
| InternVL2.5-78BModel Name=InternVL2.5-78B2024.12 | 65.5 | |
| InternVL2-40BModel Name=InternVL2-40B2024.12 | 63.8 | |
| InternVL2.5-38BModel Name=InternVL2.5-38B2024.12 | 62.1 | |
| InternVL2.5-26BModel Name=InternVL2.5-26B2024.12 | 60.8 | |
| InternVL2.5-8BModel Name=InternVL2.5-8B2024.12 | 58.1 | |
| InternVL2-26BModel Name=InternVL2-26B2024.12 | 57.2 | |
| Claude-3-OpusModel Name=Claude-3-Opus2024.12 | 55.8 | |
| InternVL2.5-4BModel Name=InternVL2.5-4B2024.12 | 55.4 | |
| InternVL2.5-2BModel Name=InternVL2.5-2B2024.12 | 52.3 | |
| InternVL2-8BModel Name=InternVL2-8B2024.12 | 52.3 | |
| InternVL-Chat-V1.5Model Name=InternVL-Chat-V1.52024.12 | 51.5 | |
| InternVL2-4BModel Name=InternVL2-4B2024.12 | 46.6 | |
| InternVL2.5-1BModel Name=InternVL2.5-1B2024.12 | 43.2 | |
| InternVL2-2BModel Name=InternVL2-2B2024.12 | 39.6 | |
| InternVL2-1BModel Name=InternVL2-1B2024.12 | 36.1 |