List your company

Multimodal Understanding on MMMU (MMMU Metric)

57.6MMMU ScoreGPT-5 Nano
23.2832.1941.150.01May 23, 2025Jul 14, 2025Sep 4, 2025Oct 27, 2025Dec 18, 2025Feb 8, 2026Apr 2, 2026

Evaluation results

MethodLinks
GPT-5 Nano2026.0457.6
InternVL3.5Params=8B2026.0457.3
InternVL3Params=8B2026.0454.8
Qwen3-VLParams=8B2026.0452.8
Qwen2.5-VLParams=7B2026.0451.1
UniDriveVLAParams=8B2026.0447.3
Slot-MLLM (14B)LLM=Qwen2.5-14B-Instruct, PT Data Size=25M2025.0546.7
UniTokLLM=LLaMA-2-7B, PT Data Size=70M2025.0533.2
Slot-MLLM (7B)LLM=Vicuna-7B, PT Data Size=25M2025.0533.2
VILA-ULLM=LLaMA-2-7B, PT Data Size=23M2025.0529.2
SEED-LLaMALLM=Vicuna-7B, PT Data Size=77M2025.0526.8
LaVITLLM=LLaMA-7B, PT Data Size=100M2025.0524.6