ResearchBenchmarksRanking Evaluation on English fine-tuning corpus 3B tokensRanking Evaluation on English fine-tuning corpus 3B tokensFollow0.904Observed LossLinear-H0.903360.907680.9120.91632Sep 7, 2024Evaluation resultsMethodMethodLinksObserved LossPredicted ScoreActual RankPredicted RankLinear-HSchedule=Linear-H, ηma...Schedule=Linear-H, ηmax=1.5×10−3, a1=128, a3=1282024.090.9042.10211Linear-LSchedule=Linear-L, ηma...Schedule=Linear-L, ηmax=10−3, a1=512, a3=5122024.090.9092.15822Linear-SSchedule=Linear-S, ηma...Schedule=Linear-S, ηmax=5×10−4, a1=128, a3=1282024.090.922.30233