Zero-shot Language Evaluation on DCLM Pro
57.93WinoGrandePathMoE
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PathMoETotal Parameters=16.2B, Active Parameters=2.13B, Evaluation=Zero-shot2026.03 | 57.93 | 71.38 | 40.07 | 48.73 | 53.64 | 63.32 | 64.01 | 39.6 | 68.52 | 40.1 | 21.18 | 35.64 | 50.34 | |
| Indep-MoETotal Parameters=16.2B, Active Parameters=2.13B, Evaluation=Zero-shot2026.03 | 56.12 | 68.99 | 40.58 | 43 | 51.97 | 63.22 | 63.06 | 35.8 | 63.43 | 37.29 | 21.91 | 35.27 | 48.39 |