General Evaluation on Downstream Suite
39.38Average ScoreDCDM (MoE)
Evaluation results
| Method | Links | |
|---|---|---|
| DCDM (MoE)Scale=1.5B, Active Params=1.2B (2.8B)2026.05 | 39.38 | |
| DCDMScale=1.5B, Active Params=1.5B2026.05 | 39.01 | |
| BDLMScale=1.5B, Active Params=1.5B2026.05 | 38.09 | |
| MDLMScale=1.5B, Active Params=1.5B2026.05 | 36.14 | |
| DCDM (MoE)Scale=0.5B, Active Params=0.4B (0.8B)2026.05 | 34.29 | |
| DCDMScale=0.5B, Active Params=0.5B2026.05 | 33.68 | |
| BDLMScale=0.5B, Active Params=0.5B2026.05 | 32.92 | |
| MDLMScale=0.5B, Active Params=0.5B2026.05 | 30.96 |