List your company

Multi-modal Question Answering on MMMU Pros

75AccuracyQwen3.5-27B
34.876845.293455.7166.1266Oct 27, 2025Nov 23, 2025Dec 20, 2025Jan 17, 2026Feb 13, 2026Mar 12, 2026Apr 9, 2026

Evaluation results

MethodLinks
Qwen3.5-27BMode=REASONING, Architecture=Dense, # Total Params=27B, # Activated Params=27B2026.0475
Qwen3-VL-235B-A22BMode=Thinking, Architecture=MoE, # Total Params=236B, # Activated Params=23B2026.0469.3
EXAONE 4.5 33BMode=REASONING, Architecture=Dense, # Total Params=33B, # Activated Params=33B2026.0468.6
Qwen3-VL-32BMode=Thinking, Architecture=Dense, # Total Params=33B, # Activated Params=33B2026.0468.1
GPT-5 miniMode=REASONING: HIGH, Architecture=-, # Total Params=-, # Activated Params=-2026.0467.3
MergeMixbaseline=SFT Vision2025.1037.46
VisionThink-7B2025.1037.27
SFT Vision2025.1036.7
Qwen2.5-VL-Ins-7B2025.1036.42