List your company
ResearchFormerly WizWand

General Knowledge on MMLU (Score)

90.1ScoreQwen 3 VL 32B Think
58.27666.53874.883.062Dec 15, 2025Dec 24, 2025Jan 3, 2026Jan 13, 2026Jan 22, 2026Feb 1, 2026Feb 11, 2026
Updated 8mo ago

Evaluation results

MethodLinks
Qwen 3 VL 32B ThinkModel Family=Qwen 3, Parameter Count=32B, Thinking Capability=true2025.1290.1
Qwen 3 32BModel Family=Qwen 3, Parameter Count=32B, Thinking Capability=false2025.1288.8
K2-V2 70B InstructModel Family=K2, Parameter Count=70B, Thinking Capability=false2025.1288.4
DS-R1 32BModel Family=DeepSeek-R1, Parameter Count=32B, Thinking Capability=true2025.1288
DeepSeek V3.2Model Variant=Exp Base, # Shots=5-shot, # Activated Params=37B, # Total Params=671B2026.0287.8
Kimi-K2Model Variant=Base, # Shots=5-shot, # Activated Params=32B, # Total Params=1043B2026.0287.8
DeepSeek V3.1Model Variant=Base, # Shots=5-shot, # Activated Params=37B, # Total Params=671B2026.0287.4
MiMo-V2 FlashModel Variant=Base, # Shots=5-shot, # Activated Params=15B, # Total Params=309B2026.0286.7
Qwen 3 VL 8B Think2025.1286.5
Olmo 3.1 Think 32BTraining Stage=Final Think 3.1, Model Family=Olmo 3.1, Parameter Count=32B, Thinking Capability=true2025.1286.4
GLM-4.5Model Variant=Base, # Shots=5-shot, # Activated Params=32B, # Total Params=355B2026.0286.1
Step 3.5 FlashModel Variant=Base, # Shots=5-shot, # Activated Params=11B, # Total Params=196B2026.0285.8
Olmo 3 Think (Final 3.0)Training Stage=Final Think 3.0, Model Family=Olmo 3, Parameter Count=32B, Thinking Capability=true2025.1285.4
Qwen 3 8B2025.1285.4
Olmo 3 Think (SFT)Training Stage=SFT, Model Family=Olmo 3, Parameter Count=32B, Thinking Capability=true2025.1285.3
Olmo 3 Think (DPO)Training Stage=DPO, Model Family=Olmo 3, Parameter Count=32B, Thinking Capability=true2025.1285.2
Nemotron Nano 9B v22025.1284.3
OR Nemotron 7B2025.1280.7
Olmo 3 7B ThinkStage=Final Think2025.1277.8
OpenThinker3 7B2025.1277.4
Olmo 3 7B ThinkStage=SFT2025.1274.9
Olmo 3 7B ThinkStage=DPO2025.1274.8
DS-R1 Qwen 7B2025.1267.9
KEELArchitecture=512 Layers / 3B Params, Peak Learning Rate=4.5 x 10^-3, Pre-training Tokens=1T, Evaluation Protocol (Shots)=5-shot2026.0162.7
Pre-LNArchitecture=512 Layers / 3B Params, Peak Learning Rate=3.0 x 10^-3, Pre-training Tokens=1T, Evaluation Protocol (Shots)=5-shot2026.0159.5