World Knowledge on MMLU (EM)
90.1EM (World Knowledge)DeepSeek-V4-Pro Base
Evaluation Results
| Method | Links | |
|---|---|---|
| DeepSeek-V4-Pro Base# Shots=5-shot, Architecture=MoE, # Activated Params=49B, # Total Params=1.6T2026.04 | 90.1 | |
| DeepSeek-V4-Flash Base# Shots=5-shot, Architecture=MoE, # Activated Params=13B, # Total Params=284B2026.04 | 88.7 | |
| DeepSeek-V3.2 Base# Shots=5-shot, Architecture=MoE, # Activated Params=37B, # Total Params=671B2026.04 | 87.8 | |
| Sigma-MoE-Tiny Base# Shots=5-shot, Architecture=MoE, # Activated Params=0.5B, # Total Params=20B2025.12 | 64.81 | |
| Gemma-3 4B Base# Shots=5-shot, Architecture=Dense, # Activated Params=4B, # Total Params=4B2025.12 | 59.51 | |
| DeepSeek-V2 Lite# Shots=5-shot, Architecture=MoE, # Activated Params=2.4B, # Total Params=15.7B2025.12 | 58.3 | |
| Qwen3 0.6B Base# Shots=5-shot, Architecture=Dense, # Activated Params=0.6B, # Total Params=0.6B2025.12 | 52.81 |