ResearchDatasetsPublic Pretraining DatasetFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsLanguage ModelingPublic Pretraining Dataset OOD1.606Loss4Language ModelingPublic Pretraining Dataset (train)1.33Loss4