ResearchBenchmarksLanguage Modeling on PG-19 (128K context length)Language Modeling on PG-19 (128K context length)Follow7.244PerplexityDense7.243967.244237.24457.24477May 20, 2026Evaluation resultsMethodMethodLinksPerplexityDelta Perplexity95% Confidence IntervalRatioDenseContext Length=128K, N...Context Length=128K, Number of chunks=202026.057.244———CertifiedContext Length=128K, N...Context Length=128K, Number of chunks=202026.057.2450.0010.0011.0001