ResearchBenchmarksOptimizer State Memory Measurement on Qwen3-30B-A3B (train)Follow111.4Optimizer State Memory (MB)PowerStep81.296284.498487.7690.902May 11, 2026Evaluation ResultsMethodMethodLinksOptimizer State Memory (MB)PowerStepPrecision=int8, Number...Precision=int8, Number of NPUs=2562026.05111.4AdamWPrecision=fp32, Number...Precision=fp32, Number of NPUs=2562026.05864