List your company
ResearchFormerly WizWand

Multimodal Understanding on MMMU (Score)

81.8MMMU ScoreGPT-5-Thinking
26.78441.06755.3569.633May 23, 2025Jul 27, 2025Sep 30, 2025Dec 4, 2025Feb 7, 2026Apr 13, 2026Jun 18, 2026
Updated 4mo ago

Evaluation results

MethodLinks
GPT-5-ThinkingModel Category=Close-source Models2025.0981.8
Gemini 2.5 FlashSize=-, mode=instruct2026.0476.3
Gemini-2.5-ProModel Category=Close-source Models2025.0974.7
InternVL3.5Size=8B, mode=instruct2026.0473.4
Audio Flamingo3Model Category=Specialized Models2026.0472.42
Ming-OmniModel Category=Unified Models2026.0470.8
LongCat-Next2026.0370.6
Qwen3-VLSize=8B, mode=instruct2026.0469.6
Qwen3-OmniSize=30B-A3B, mode=instruct2026.0469.1
NEO-unify2026.0368.9
MiniCPM-o 4.5Size=9B, mode=instruct2026.0467.6
SPOT-EBase Model=Qwen3-VL-32B2026.0664.6
Qwen2.5-Omni-3BModel Category=Specialized Models2026.0463.3
Audio-OmniModel Category=Unified Models2026.0463.3
Qwen3-VL-32BBase Model=Qwen3-VL-32B2026.0663.2
SPOT-EBase Model=Qwen2.5-VL-32B2026.0663
SPOT-EBase Model=InternVL2.5-26B2026.0662.7
Qwen2.5-VL-32BBase Model=Qwen2.5-VL-32B2026.0661.4
InternVL2.5-26BBase Model=InternVL2.5-26B2026.0660.8
VAPO-Thinker-7BModel Category=Our Models2025.0960.2
VLAA-Thinker-7BModel Category=Open-source Models2025.0959.1
Lumina2026.0358.6
UniWorld-V12026.0358.6
UniWorld-V1Params=12B2025.1158.6
Qwen2.5-VLLLM=Qwen2.5-7B2025.0558.6
Vision-R1-7BModel Category=Open-source Models2025.0957.6
Qwen2-Audio-InstructModel Category=Specialized Models2026.0457.4
InternVL2.5-8BModel Category=Open-source Models2025.0956.2
InternVL2.5LLM=InternLM2.5-7B2025.0556
VAPO-Thinker-3BModel Category=Our Models2025.0955.6
BAGEL2026.0355.3
BAGELParams=14B2025.1155.3
InternVL-U2026.0354.7
R1-OneVision-7BModel Category=Open-source Models2025.0954.3
Bagel+LatentUMM2026.0553.2
OmniGen22026.0353.1
OminiGen2Params=7B2025.1153.1
Bagel+UniCot2026.0553.1
Qwen2.5-VL-7BModel Category=Open-source Models2025.0952.7
Bagel+UniGame2026.0552.4
Bagel+RecA2026.0552.3
BagelParams=14B2026.0551.9
Bagel+SFT2026.0551.9
SPOT-EBase Model=LLaVA-OV-72B2026.0651.8
Ovis-U12026.0351.1
BLIP3-o2026.0350.6
BLIP3-oParams=8B2025.1150.6
LLaVA-OV-72BBase Model=LLaVA-OV-72B2026.0649.8
Show-o22026.0348.9
LLaVA-OneVisionLLM=Qwen2-7B2025.0548.8
Show-O2Params=7B2026.0547.9
Slot-MLLM (14B)LLM=Qwen2.5-14B-Instruct2025.0546.7
Omnigen2Params=7B2026.0546
Mogao2026.0344.2
UniGameParams=7B2025.1143.8
TokenFlow-XLParams=14B2025.1143.2
OneCAT2026.0341.9
Qwen2-VL-2BLLM=Qwen2-1.5B, Retain Ratio (%)=100%2026.0541.7
SFTParams=7B2025.1141.2
Janus-Pro2026.0341
Janus-Pro†Params=7B2025.1141
Janus ProParams=7B2026.0540.7
VEN-VLLLM=Qwen3-1.7B, Retain Ratio (%)=∼ 7.5%2026.0539.7
MiniCPM-V2LLM=MiniCPM-2.4B, Retain Ratio (%)=100%2026.0539.6
TokenFlow-XLType=Und. & Gen., # Params=13B2025.0938.7
ILLUMEType=Und. & Gen., # Params=7B2025.0938.2
VEN-VLLLM=Qwen2.5-1.5B, Retain Ratio (%)=∼ 10%2026.0537.9
Show-O2Params=1.5B2026.0537.1
TinyLLaVA†LLM=Qwen2.5-1.5B, Retain Ratio (%)=100%2026.0537
Janus-Pro-1BType=Und. & Gen., # Params=1.5B2025.0936.3
VisionZipLLM=Vicuna-7B, Retain Ratio (%)=∼ 10%2026.0536.2
Qwen-VL-ChatLLM=Qwen-7B, Retain Ratio (%)=100%2026.0535.9
LLaVA-NeXTLLM=Vicuna-7B2025.0535.8
RecAParams=1.5B2025.1135.7
SEED-XParams=7B2025.1135.6
VEN-VLLLM=Qwen3-0.6B, Retain Ratio (%)=∼ 7.5%2026.0535.6
LLaVA-v1.5Type=Und. Only, # Params=7B2025.0935.4
OursType=Und. & Gen., # Params=1.5B2025.0935.4
PinPointTraining Data=GQA, Avg. FLOPs(T)=24.39 (61.1%)2026.0335
InternVL2-2BLLM=InternLM2-1.8B, Retain Ratio (%)=100%2026.0534.9
LLaVA-1.5LLM=Vicuna-7B, Retain Ratio (%)=100%2026.0534.4
FUDOKIType=Und. & Gen., # Params=1.5B2025.0934.3
PDropTraining Data=Train-free, Avg. FLOPs(T)=26.00 (65.1%)2026.0334.11
VanillaTraining Data=-, Avg. FLOPs(T)=39.92 (100.0%)2026.0334.1
TinyLLaVA†LLM=Qwen1.5-1.8B, Retain Ratio (%)=100%2026.0534.1
FastVLLM=Vicuna-7B, Retain Ratio (%)=∼ 10%2026.0534
TinyLLaVA†LLM=Qwen2.5-0.5B, Retain Ratio (%)=100%2026.0533.6
FastVTraining Data=Train-free, Avg. FLOPs(T)=28.17 (70.6%)2026.0333.56
Slot-MLLM (7B)LLM=Vicuna-7B2025.0533.2
SparseVLMLLM=Vicuna-7B, Retain Ratio (%)=∼ 10%2026.0532.7
Mini-Gemini-2BLLM=Gemma-2B, Retain Ratio (%)=100%2026.0531.7
Emu3Params=8B2025.1131.6
Emu3-ChatType=Und. Only, # Params=8B2025.0931.6
TinyLLaVA†LLM=Qwen1.5-0.5B, Retain Ratio (%)=100%2026.0531.6
Emu3Params=8B2026.0531.4
LLaVA-Phi-1.5Type=Und. Only, # Params=1.3B2025.0930.7
JanusType=Und. & Gen., # Params=1.5B2025.0930.5
Emu3.5Params=34B2026.0529.2
Janus FlowParams=1.3B2026.0529
MMaDAParams=8B2026.0528.9