Reasoning on MMMU (val)
52.4MMMU ScoreQwen3-VL
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-VLVision Encoder=Qwen3ViT, LLM=Qwen3-8B, Model Adaptation Type=Open Source2026.02 | 52.4 | |
| Qwen2.5-VLVision Encoder=Qwen2.5ViT, LLM=Qwen2-7B, Model Adaptation Type=Open Source2026.02 | 50.9 | |
| SigLIP2 | Qwen-3-4BVision Encoder=SigLIP2, LLM=Qwen-3-4B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 50.4 | |
| SigLIP2 | Qwen-3-8BVision Encoder=SigLIP2, LLM=Qwen-3-8B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 49.1 | |
| LLaVA-OVVision Encoder=SigLIP, LLM=Qwen2-7B, Model Adaptation Type=Open Source2026.02 | 46.4 | |
| SigLIP2 | Llama-3.1-8BVision Encoder=SigLIP2, LLM=Llama-3.1-8B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 43.9 | |
| SigLIP | Gemma3-4BVision Encoder=SigLIP, LLM=Gemma3-4B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 43.8 | |
| SigLIP2 | Lilium-8BVision Encoder=SigLIP2, LLM=Lilium-8B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 42.3 | |
| SigLIP2 | e-Llama3.1-8BVision Encoder=SigLIP2, LLM=e-Llama3.1-8B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 42 | |
| Qwen2.5ViT | e-Llama3.1-8BVision Encoder=Qwen2.5ViT, LLM=e-Llama3.1-8B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 39.7 | |
| Gemma3Vision Encoder=SigLIP, LLM=Gemma3-4B, Model Adaptation Type=Open Source2026.02 | 39.7 | |
| SigLIP2 | Lilium-4BVision Encoder=SigLIP2, LLM=Lilium-4B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 37.8 | |
| SigLIP2 | Lilium-1BVision Encoder=SigLIP2, LLM=Lilium-1B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 35.4 |