ResearchDatasetsUL2FollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsLanguage ModelingUL2 Pre-training (val)1.841Loss14