Multilingual text-centric visual question answering on MTVQA
32.7Average ScoreBlueLM-V
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| BlueLM-VParams=3B2024.11 | 32.7 | — | — | — | — | — | — | — | — | — | |
| InternVL2.5Number of Parameters=78B2025.02 | 31.9 | — | — | — | — | — | — | — | — | — | |
| InternVL2.5-78BParameters=78B2024.12 | 31.9 | — | — | — | — | — | — | — | — | — | |
| Qwen2.5-VLNumber of Parameters=72B2025.02 | 31.7 | — | — | — | — | — | — | — | — | — | |
| InternVL2.5-38BParameters=38B2024.12 | 31.7 | — | — | — | — | — | — | — | — | — | |
| Qwen2-VLNumber of Parameters=72B2025.02 | 30.9 | — | — | — | — | — | — | — | — | — | |
| Qwen2-VL-72BParameters=72B2024.12 | 30.9 | — | — | — | — | — | — | — | — | — | |
| Qwen2.5-VLNumber of Parameters=7B2025.02 | 29.2 | — | — | — | — | — | — | — | — | — | |
| InternVL3.5-2Bparameters=2B2025.12 | 28.5 | — | — | — | — | — | — | — | — | — | |
| InternVL2.5-26BParameters=26B2024.12 | 28.5 | — | — | — | — | — | — | — | — | — | |
| InternVL2.5-4BParameters=4B2024.12 | 28.4 | — | — | — | — | — | — | — | — | — | |
| GPT-4o 0513Model Version=05132025.02 | 27.8 | — | — | — | — | — | — | — | — | — | |
| GPT-4o2024.12 | 27.8 | — | — | — | — | — | — | — | — | — | |
| InternVL2.5-8BParameters=8B2024.12 | 27.6 | — | — | — | — | — | — | — | — | — | |
| Qwen3-VL-2Bparameters=2B, evaluated_by=VLMEvalKit2025.12 | 27.3 | — | — | — | — | — | — | — | — | — | |
| InternVL3-2Bparameters=2B2025.12 | 26.7 | — | — | — | — | — | — | — | — | — | |
| Claude-3.5 Sonnet-0620Model Version=06202025.02 | 25.7 | — | — | — | — | — | — | — | — | — | |
| jina-vlm2025.12 | 25.6 | — | — | — | — | — | — | — | — | — | |
| Qwen2-VL-7BParameters=7B2024.12 | 25.6 | — | — | — | — | — | — | — | — | — | |
| Qwen2.5-VLNumber of Parameters=3B2025.02 | 24.8 | — | — | — | — | — | — | — | — | — | |
| GPT-4V2024.12 | 22 | — | — | — | — | — | — | — | — | — | |
| InternVL2-Llama3-76BBackbone=Llama3, Parameters=76B2024.12 | 22 | — | — | — | — | — | — | — | — | — | |
| InternVL2.5-2BParameters=2B2024.12 | 21.8 | — | — | — | — | — | — | — | — | — | |
| InternVL2.5-1BParameters=1B2024.12 | 21.4 | — | — | — | — | — | — | — | — | — | |
| InternVL2-8BParameters=8B2024.12 | 20.9 | — | — | — | — | — | — | — | — | — | |
| Qwen2-VLParams=2B2024.11 | 20.7 | — | — | — | — | — | — | — | — | — | |
| Qwen2-VL-2Bparameters=2B2025.12 | 20.6 | — | — | — | — | — | — | — | — | — | |
| InternVL2-40BParameters=40B2024.12 | 20.6 | — | — | — | — | — | — | — | — | — | |
| InternVL-Chat-V1.5Version=V1.52024.12 | 20.5 | — | — | — | — | — | — | — | — | — | |
| Qwen2-VL-2BParameters=2B2024.12 | 20 | — | — | — | — | — | — | — | — | — | |
| InternVL2-26BParameters=26B2024.12 | 17.7 | — | — | — | — | — | — | — | — | — | |
| InternVL2Params=4B2024.11 | 15.5 | — | — | — | — | — | — | — | — | — | |
| InternVL2-4BParameters=4B2024.12 | 15.3 | — | — | — | — | — | — | — | — | — | |
| Phi-3-VisionParams=4.2B2024.11 | 13.9 | — | — | — | — | — | — | — | — | — | |
| InternVL2-1BParameters=1B2024.12 | 12.6 | — | — | — | — | — | — | — | — | — | |
| InternVL2-2BParameters=2B2024.12 | 10.9 | — | — | — | — | — | — | — | — | — | |
| MiniCPM-V-2Params=2.8B2024.11 | 9.3 | — | — | — | — | — | — | — | — | — | |
| BlueLM-V-3B2025.09 | — | 17.3 | 39.5 | 44.7 | 32.2 | 23.5 | 34 | 9.2 | 20.3 | 22.9 | |
| DeepSeek-VL-7B2025.09 | — | 1.4 | 18.4 | 20.4 | 18 | 5.1 | 7 | 1.6 | 3.5 | 7.2 | |
| Eagle2-9B2025.09 | — | 17 | 29.1 | 34.8 | 37 | 17.6 | 33.3 | 10.2 | 13.4 | 32.2 | |
| Gemini-2.5-flash2025.09 | — | 21.6 | 36.8 | 41.7 | 43 | 19.8 | 36.3 | 15.8 | 26.9 | 41.7 | |
| GLM-4v-9B2025.09 | — | 7 | 31.4 | 39.3 | 37.9 | 11.1 | 13.4 | 8.1 | 8.2 | 26.6 | |
| GPT-4o-2024-05-132025.09 | — | 21.3 | 35.1 | 42.2 | 37.2 | 19.9 | 35.1 | 15.9 | 26 | 39.6 | |
| InternVL3-2B2025.09 | — | 5.5 | 34 | 41.1 | 39.7 | 19.6 | 31.5 | 9.4 | 16.5 | 28.5 | |
| InternVL3-8B2025.09 | — | 9.8 | 37.4 | 45.5 | 41.4 | 22.3 | 31.9 | 11.4 | 18.2 | 38.5 | |
| InternVL3.5-2B2025.09 | — | 9.2 | 34.5 | 42.3 | 39.8 | 20.9 | 32.7 | 10.8 | 17.9 | 29.8 | |
| InternVL3.5-8B2025.09 | — | 16.1 | 38.2 | 44.1 | 40.6 | 22.8 | 33.7 | 11.6 | 20.2 | 39.8 | |
| LaV-CoT-3Btraining=SFT2025.09 | — | 19.8 | 33.7 | 38.1 | 33.6 | 20.7 | 37.1 | 10.4 | 22.1 | 37.7 | |
| LaV-CoT-3Btraining=SFT + GRPO2025.09 | — | 23.2 | 35.3 | 42.8 | 35.9 | 23.1 | 38.2 | 11.5 | 23.8 | 38.8 | |
| LLaVA-OneVision-7B2025.09 | — | 5 | 21 | 22.3 | 26.1 | 6.2 | 7.3 | 6 | 3 | 13.6 | |
| Monkey-9.8B2025.09 | — | 1.1 | 16.4 | 21.2 | 21.7 | 4.3 | 5.4 | 5.3 | 6.1 | 8.4 | |
| PARROT-7B2025.09 | — | 14.3 | 30.1 | 34.6 | 36.7 | 16.3 | 20.2 | 9.5 | 9.9 | 27.8 | |
| Qwen2-VL-2B2025.09 | — | 7.1 | 27 | 27.5 | 32.6 | 12.9 | 23.7 | 11 | 3.9 | 24.1 | |
| Qwen2-VL-7B2025.09 | — | 16.2 | 30.5 | 35.8 | 36.9 | 16.8 | 30.1 | 11.1 | 11.3 | 28.7 | |
| Qwen2.5-VL-3B2025.09 | — | 11.7 | 27.3 | 33.3 | 31.7 | 12.7 | 26.2 | 10.3 | 10.4 | 35.6 | |
| Qwen2.5-VL-7B2025.09 | — | 17.8 | 30.5 | 33.3 | 37.2 | 18.5 | 38 | 13.6 | 15.2 | 44.8 |