ResearchBenchmarksLanguage Modeling on Fineweb-Edu (Accuracy)Language Modeling on Fineweb-Edu (Accuracy)Follow0.3919AccuracyGating0.3885720.3894360.39030.391164Feb 16, 2026Evaluation resultsMethodMethodLinksAccuracyGatingconfiguration=gating,...configuration=gating, strategy=learnable residual gating2026.020.3919Fixed-cutconfiguration=fixed-cu...configuration=fixed-cut, strategy=fixed attenuation2026.020.3898Baselineconfiguration=baselineconfiguration=baseline2026.020.3887