ResearchBenchmarksLanguage Modeling on C4 (Perplexity and Memory)Language Modeling on C4 (Perplexity and Memory)Follow11.96PerplexitySCALE11.956411.980712.00512.0293Jun 20, 2025Evaluation resultsMethodMethodLinksPerplexityMemory (GB)SCALEModel=Gemma-2B, Tokens...Model=Gemma-2B, Tokens=32B2025.0611.966.06APOLLOModel=Gemma-2B, Tokens...Model=Gemma-2B, Tokens=32B2025.0612.059.09