General Visual Question Answering on MM-Vet
69.1AccuracyGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oInference mode=Zero-shot2024.10 | 69.1 | |
| GPT-4o-miniInference mode=Zero-shot2024.10 | 66.9 | |
| Baichuan-omniInference mode=Zero-shot, Parameters=7B2024.10 | 65.4 | |
| Qwen2 VLInference mode=Zero-shot, Parameters=7B2024.10 | 62 | |
| Gemini-ProAccess Type=Closed-source API2024.07 | 59.2 | |
| GLM-4vModel Size=14B, Access Type=Open-source2024.07 | 58 | |
| GPT-4VAccess Type=Closed-source API2024.07 | 56.8 | |
| MiniCPM-Llama3-V 2.5Inference mode=Zero-shot, Parameters=8B2024.10 | 52 | |
| IXC-2.5-7BModel Size=7B2024.07 | 51.7 | |
| VITAInference mode=Zero-shot, Parameters=8x7B2024.10 | 41.6 |