ResearchBenchmarksLanguage Modeling on Huginn held-out (val)Language Modeling on Huginn held-out (val)Follow10.09PerplexityParcae9.924411.042212.1613.2778Apr 14, 2026Evaluation resultsMethodMethodLinksPerplexityParcaeParameters=350M, T=8,...Parameters=350M, T=8, Evaluation Protocol=Zero-shot2026.0410.09RDMParameters=350M, T=8,...Parameters=350M, T=8, Evaluation Protocol=Zero-shot2026.0410.76ParcaeParameters=100M, T=16,...Parameters=100M, T=16, Evaluation Protocol=Zero-shot2026.0413.59RDMParameters=100M, T=16,...Parameters=100M, T=16, Evaluation Protocol=Zero-shot2026.0414.23