List your company
ResearchFormerly WizWand

Multi-modal Understanding on MMMU (Accuracy)

49.1AccuracyViQ
29.75634.77839.844.822Jun 24, 2026Jun 25, 2026
Updated 4mo ago

Evaluation results

MethodLinks
ViQBase LLM=Qwen2.5-7B, Size=1.3B, AnyRes=true, Discrete=true2026.0649.1
ViQBase LLM=Qwen2.5 - 7B, Size=1.3B, AnyRes=true, Discrete=true2026.0649.1
SigLIP2-gBase LLM=Qwen2.5-7B, Size=1.1B, AnyRes=false, Discrete=false2026.0648.3
SigLIP2-gBase LLM=Qwen2.5 - 7B, Size=1.1B, AnyRes=false, Discrete=false2026.0648.3
AIMv2-HBase LLM=Qwen2.5-7B, Size=0.7B, AnyRes=false, Discrete=false2026.0648.2
AIMv2-HBase LLM=Qwen2.5 - 7B, Size=0.7B, AnyRes=false, Discrete=false2026.0648.2
OryxViTBase LLM=Qwen2.5-7B, Size=0.4B, AnyRes=true, Discrete=false2026.0648.1
InternViT-2.5-6BBase LLM=Qwen2.5-7B, Size=6.0B, AnyRes=false, Discrete=false2026.0648.1
OryxViTBase LLM=Qwen2.5 - 7B, Size=0.4B, AnyRes=true, Discrete=false2026.0648.1
InternViT-2.5-6BBase LLM=Qwen2.5 - 7B, Size=6.0B, AnyRes=false, Discrete=false2026.0648.1
OAI-CLIP-LBase LLM=Qwen2.5-7B, Size=0.3B, AnyRes=false, Discrete=false2026.0647.1
OAI-CLIP-LBase LLM=Qwen2.5 - 7B, Size=0.3B, AnyRes=false, Discrete=false2026.0647.1
ViQBase LLM=Qwen2.5-1.5B, Size=1.3B, AnyRes=true, Discrete=true2026.0642.6
ViQBase LLM=Qwen2.5 - 1.5B, Size=1.3B, AnyRes=true, Discrete=true2026.0642.6
SigLIP2-gBase LLM=Qwen2.5-1.5B, Size=1.1B, AnyRes=false, Discrete=false2026.0642.4
SigLIP2-gBase LLM=Qwen2.5 - 1.5B, Size=1.1B, AnyRes=false, Discrete=false2026.0642.4
OryxViTBase LLM=Qwen2.5-1.5B, Size=0.4B, AnyRes=true, Discrete=false2026.0642.1
InternViT-2.5-6BBase LLM=Qwen2.5-1.5B, Size=6.0B, AnyRes=false, Discrete=false2026.0642.1
OryxViTBase LLM=Qwen2.5 - 1.5B, Size=0.4B, AnyRes=true, Discrete=false2026.0642.1
InternViT-2.5-6BBase LLM=Qwen2.5 - 1.5B, Size=6.0B, AnyRes=false, Discrete=false2026.0642.1
DinoV2-gBase LLM=Qwen2.5-1.5B, Size=1.1B, AnyRes=false, Discrete=false2026.0641.8
AIMv2-HBase LLM=Qwen2.5-1.5B, Size=0.7B, AnyRes=false, Discrete=false2026.0641.8
DinoV2-gBase LLM=Qwen2.5 - 1.5B, Size=1.1B, AnyRes=false, Discrete=false2026.0641.8
AIMv2-HBase LLM=Qwen2.5 - 1.5B, Size=0.7B, AnyRes=false, Discrete=false2026.0641.8
OAI-CLIP-LBase LLM=Qwen2.5-1.5B, Size=0.3B, AnyRes=false, Discrete=false2026.0640.7
OAI-CLIP-LBase LLM=Qwen2.5 - 1.5B, Size=0.3B, AnyRes=false, Discrete=false2026.0640.7
InternViT-2.5Base LLM=Qwen2.5-1.5B, Size=0.3B, AnyRes=false, Discrete=false2026.0640.3
InternViT-2.5Base LLM=Qwen2.5 - 1.5B, Size=0.3B, AnyRes=false, Discrete=false2026.0640.3
QLIPBase LLM=Qwen2.5-1.5B, Size=0.3B, AnyRes=false, Discrete=true2026.0636.9
QLIPBase LLM=Qwen2.5 - 1.5B, Size=0.3B, AnyRes=false, Discrete=true2026.0636.9
UniTokBase LLM=Qwen2.5-1.5B, Size=0.3B, AnyRes=false, Discrete=true2026.0636.1
UniTokBase LLM=Qwen2.5 - 1.5B, Size=0.3B, AnyRes=false, Discrete=true2026.0636.1
MolmoE-1B-7BAvg_k=8.002026.0631.2
GeMoEAvg_k=5.432026.0630.5