Mathematical Reasoning on AIME 2024 (Accuracy avg@16)
65.4Accuracy (avg@16)Sigma-MoE-Tiny
Evaluation results
| Method | Links | |
|---|---|---|
| Sigma-MoE-TinyArchitecture=MoE, # Activated Params=0.5B, # Total Params=20B2025.12 | 65.4 | |
| DeepSeek-R1-Distill-Qwen-7BArchitecture=Dense, # Activated Params=7B, # Total Params=7B2025.12 | 55.5 | |
| DeepSeek-R1-Distill-Llama-8BArchitecture=Dense, # Activated Params=8B, # Total Params=8B2025.12 | 50.4 | |
| Qwen3-1.7BArchitecture=Dense, # Activated Params=1.7B, # Total Params=1.7B2025.12 | 48.3 | |
| Phi-3.5-MoEArchitecture=MoE, # Activated Params=6.6B, # Total Params=42B2025.12 | 13.3 |