ResearchDatasetsEnglish tokensEnglish tokensFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsContinual Training100B English tokens Weak distribution shift (near-tie)1.991Observed Loss5