ResearchBenchmarksOptimizer Property Comparison on General Theoretical AnalysisOptimizer Property Comparison on General Theoretical AnalysisFollow1FLOPs per StepAdam0.921.4622.54May 1, 2026Evaluation resultsMethodMethodLinksFLOPs per StepParameter Memory UsageFirst Moment MaintenanceSecond Moment MaintenanceAdam2026.0513——MeZO2026.052———HELENE2026.0523——AdaMeZO2026.0521——HiZOO2026.0532——