General VQA on MMMU pt-PT
53.7AccuracyInternVL3.5-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| InternVL3.5-8BOpen weights=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 53.7 | |
| LLaVA-OV1.5-8BOpen weights=true, Fully open vision data=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 52.9 | |
| Molmo2-8BOpen weights=true, Fully open vision data=true, Fully open LLM=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 52.7 | |
| Qwen3.5-9BOpen weights=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 52.2 | |
| Qwen3-VL-8BOpen weights=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 51.3 | |
| Nemotron-Nano-12BOpen weights=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 50.7 | |
| GLM-4.6V-FlashOpen weights=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 48.6 | |
| Gemma-3-12BOpen weights=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 47.8 | |
| Ministral-3-8BOpen weights=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 45.4 | |
| MiniCPM-V4Open weights=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 44.9 | |
| AMALIA-VLOpen weights=true, Fully open vision data=true, Fully open LLM=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 41.1 | |
| AMALIA-VL-DPOOpen weights=true, Fully open vision data=true, Fully open LLM=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 40.3 | |
| TowerVision-9BOpen weights=true, Fully open vision data=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 39.1 | |
| Perception-LM-8BOpen weights=true, Fully open vision data=true, Fully open LLM=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 37.7 | |
| EuroVLM-9BOpen weights=true, Fully open LLM=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 34 | |
| Salamandra-VL-7BOpen weights=true, Fully open vision data=true, Fully open LLM=true, Temperature=0, Translation Model=Gemini-3.1-Pro2026.06 | 27.7 |