ResearchBenchmarksLanguage Modeling on depth-12 LMLanguage Modeling on depth-12 LMFollow32Readable Cells RateDDC612.7519.526.25Jun 28, 2026Evaluation resultsMethodMethodLinksReadable Cells RateDDCSetting=depth-12 LM, o...Setting=depth-12 LM, over-training, base optimiser=Adam, n=32026.0632AdamWSetting=depth-12 LM, o...Setting=depth-12 LM, over-training, base optimiser=Adam, n=32026.067