Contextual Reasoning on BigBenchHard
63.23EMSigma-MoE-Tiny Base
Evaluation Results
| Method | Links | |
|---|---|---|
| Sigma-MoE-Tiny Base# Shots=3-shot, Architecture=MoE, # Activated Params=0.5B, # Total Params=20B2025.12 | 63.23 | |
| Gemma-3 4B Base# Shots=3-shot, Architecture=Dense, # Activated Params=4B, # Total Params=4B2025.12 | 51.7 | |
| DeepSeek-V2 Lite# Shots=3-shot, Architecture=MoE, # Activated Params=2.4B, # Total Params=15.7B2025.12 | 44.1 | |
| Qwen3 0.6B Base# Shots=3-shot, Architecture=Dense, # Activated Params=0.6B, # Total Params=0.6B2025.12 | 41.47 |