ResearchTasksPretrainingFor AI assistantsMarkdownContent indexPretrainingFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedLlama pretraining 124MAdamW0.674Iteration Time (s)4May 22, 2026