ResearchTasksPretrainingFollowBenchmarksDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyDataset NameSOTA methodMetricTrendResultsLast UpdatedLlama pretraining 124MAdamW0.674Iteration Time (s)4May 22, 2026