Zero-shot Reasoning and Knowledge on DCLM-Pro
58.84ARC-E AccuracyLowRank-MoE
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| LowRank-MoETotal Parameters=0.9B, Active Parameters=0.37B2026.03 | 58.84 | 59.42 | 48.26 | 40.68 | 33 | 66.54 | 40.69 | 54.38 | 50.22 | |
| PathB8-MoETotal Parameters=0.9B, Active Parameters=0.37B2026.03 | 58.16 | 58.2 | 48.26 | 40.35 | 34.4 | 66.65 | 40.33 | 54.38 | 50.09 | |
| PathMoETotal Parameters=0.9B, Active Parameters=0.37B2026.03 | 57.49 | 60.06 | 48.3 | 40.69 | 34.4 | 67.25 | 39.87 | 56.99 | 50.63 | |
| Indep-MoETotal Parameters=0.9B, Active Parameters=0.37B2026.03 | 55.18 | 56.27 | 48.19 | 40.73 | 35.8 | 66.7 | 39.46 | 55.96 | 49.79 |