List your company
ResearchFormerly WizWand

Contextual Reasoning on HellaSwag

88EMDeepSeek-V4-Pro Base
52.192861.488970.78580.0811Dec 18, 2025Jan 8, 2026Jan 30, 2026Feb 20, 2026Mar 14, 2026Apr 4, 2026Apr 26, 2026
Updated 4mo ago

Evaluation results

MethodLinks
DeepSeek-V4-Pro Base# Shots=0-shot, Architecture=MoE, # Activated Params=49B, # Total Params=1.6T2026.0488
DeepSeek-V3.2 Base# Shots=0-shot, Architecture=MoE, # Activated Params=37B, # Total Params=671B2026.0486.4
DeepSeek-V4-Flash Base# Shots=0-shot, Architecture=MoE, # Activated Params=13B, # Total Params=284B2026.0485.7
DeepSeek-V2 Lite# Shots=10-shot, Architecture=MoE, # Activated Params=2.4B, # Total Params=15.7B2025.1280.55
Sigma-MoE-Tiny Base# Shots=10-shot, Architecture=MoE, # Activated Params=0.5B, # Total Params=20B2025.1279.79
Gemma-3 4B Base# Shots=10-shot, Architecture=Dense, # Activated Params=4B, # Total Params=4B2025.1277.76
Qwen3 0.6B Base# Shots=10-shot, Architecture=Dense, # Activated Params=0.6B, # Total Params=0.6B2025.1253.57