ResearchDatasetsPublic Pretraining DatasetPublic Pretraining DatasetFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsLanguage ModelingPublic Pretraining Dataset OOD1.606Loss4Language ModelingPublic Pretraining Dataset (train)1.33Loss4