ResearchBenchmarksLanguage Modeling on Wikipedia articles En (test)Language Modeling on Wikipedia articles En (test)Follow1.1076BPC (df)GPT-21.052221.079911.10761.13529Jun 30, 2023Evaluation resultsMethodMethodLinksBPC (df)BPC (is)BPC GapRelative BPC Gap (%)ND (%)GPT-2Parameters=125MParameters=125M2023.061.10761.10260.0050.450.9