ResearchBenchmarksLanguage Modeling on Pile of Law (val)Language Modeling on Pile of Law (val)Follow2.491PerplexityMuonp2.4872.5142.5412.568Jun 11, 2026Evaluation resultsMethodMethodLinksPerplexityMuonpBase model=Llama3-1B,...Base model=Llama3-1B, Evaluation protocol=finetuning2026.062.491MuonBase model=Llama3-1B,...Base model=Llama3-1B, Evaluation protocol=finetuning2026.062.578AdamWBase model=Llama3-1B,...Base model=Llama3-1B, Evaluation protocol=finetuning2026.062.591