ResearchDatasetsUL2UL2FollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsLanguage ModelingUL2 Pre-training (val)1.841Loss14