ResearchBenchmarksOptimizer state memory measurement on Qwen3-32B (train)Follow125.9Optimizer State Memory (MB)PowerStep91.876321.538551.2780.862May 11, 2026Evaluation ResultsMethodMethodLinksOptimizer State Memory (MB)PowerStepPrecision=int8, Number...Precision=int8, Number of NPUs=2562026.05125.9AdamWPrecision=fp32, Number...Precision=fp32, Number of NPUs=2562026.05976.5