ResearchBenchmarksLanguage Modeling on PG-19 (8K context length)Language Modeling on PG-19 (8K context length)Follow12.313PerplexityCertified12.3129212.3134612.31412.31454May 20, 2026Evaluation resultsMethodMethodLinksPerplexityDelta Perplexity95% CI MagnitudeRatioCertifiedContext Length=8K, Num...Context Length=8K, Number of chunks=202026.0512.3130.0020.010.9999DenseContext Length=8K, Num...Context Length=8K, Number of chunks=202026.0512.315———