Scientific Knowledge on GPQA
27.68EMSigma-MoE-Tiny Base
Evaluation results
| Method | Links | |
|---|---|---|
| Sigma-MoE-Tiny Base# Shots=5-shot, Architecture=MoE, # Activated Params=0.5B, # Total Params=20B2025.12 | 27.68 | |
| Qwen3 0.6B Base# Shots=5-shot, Architecture=Dense, # Activated Params=0.6B, # Total Params=0.6B2025.12 | 26.77 | |
| DeepSeek-V2 Lite# Shots=5-shot, Architecture=MoE, # Activated Params=2.4B, # Total Params=15.7B2025.12 | 24.55 | |
| Gemma-3 4B Base# Shots=5-shot, Architecture=Dense, # Activated Params=4B, # Total Params=4B2025.12 | 24.24 |