ResearchBenchmarksLanguage Modeling on Wiki (test)Language Modeling on Wiki (test)Follow20.54PerplexityDAG-MoE-l20.518420.664220.8120.9558May 31, 2026Evaluation resultsMethodMethodLinksPerplexityDAG-MoE-lNumber of Parameters=699MNumber of Parameters=699M2026.0520.54MoE-lNumber of Parameters=699MNumber of Parameters=699M2026.0521.08