Contextual Reasoning on HellaSwag
88EMDeepSeek-V4-Pro Base
Evaluation Results
| Method | Links | |
|---|---|---|
| DeepSeek-V4-Pro Base# Shots=0-shot, Architecture=MoE, # Activated Params=49B, # Total Params=1.6T2026.04 | 88 | |
| DeepSeek-V3.2 Base# Shots=0-shot, Architecture=MoE, # Activated Params=37B, # Total Params=671B2026.04 | 86.4 | |
| DeepSeek-V4-Flash Base# Shots=0-shot, Architecture=MoE, # Activated Params=13B, # Total Params=284B2026.04 | 85.7 | |
| DeepSeek-V2 Lite# Shots=10-shot, Architecture=MoE, # Activated Params=2.4B, # Total Params=15.7B2025.12 | 80.55 | |
| Sigma-MoE-Tiny Base# Shots=10-shot, Architecture=MoE, # Activated Params=0.5B, # Total Params=20B2025.12 | 79.79 | |
| Gemma-3 4B Base# Shots=10-shot, Architecture=Dense, # Activated Params=4B, # Total Params=4B2025.12 | 77.76 | |
| Qwen3 0.6B Base# Shots=10-shot, Architecture=Dense, # Activated Params=0.6B, # Total Params=0.6B2025.12 | 53.57 |