Aggregate Multimodal Evaluation on Average 8 Benchmarks
74.4Average ScoreQwen-VL-Max-0809
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen-VL-Max-0809Params (B)=722024.10 | 74.4 | |
| GPT-4o-202408062024.10 | 71.5 | |
| InternVL2-Llama3-76BParams (B)=762024.10 | 71 | |
| Claude3.5-Sonnet2024.10 | 67.9 | |
| Gemini-1.5-Pro2024.10 | 64.4 | |
| Qwen2-VL-2BParams (B)=2.12024.10 | 57.2 | |
| GPT-4v (1106, detail-high)2024.10 | 56.4 | |
| Gemini-1.0-Pro2024.10 | 56.1 | |
| H2OVL-Mississippi-2BParams (B)=2.12024.10 | 54.4 | |
| InternVL2-2BParams (B)=2.12024.10 | 53.9 | |
| Phi-3-VisionParams (B)=4.22024.10 | 53.6 | |
| Claude3-Sonnet2024.10 | 53.5 | |
| MiniMonkeyParams (B)=2.22024.10 | 52.7 | |
| Qwen-VL-Plus2024.10 | 52.2 | |
| InternVL2-1BParams (B)=0.82024.10 | 48.3 | |
| MiniCPM-V-2Params (B)=2.82024.10 | 47.9 | |
| PaliGemma-3B-mix-448Params (B)=2.92024.10 | 46.5 | |
| H2OVL-Mississippi-0.8BParams (B)=0.82024.10 | 43.5 | |
| DeepSeek-VL-1.3BParams (B)=2.02024.10 | 39.6 |