ResearchDatasetsEnglish tokensFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsContinual Training100B English tokens Weak distribution shift (near-tie)1.991Observed Loss5