ResearchBenchmarksWall-clock Time on SQuAD (Question Answering)Follow0.83Wall-clock Time (hours)ZO-MOPI0.50282.71144.927.1286May 9, 2026Evaluation ResultsMethodMethodLinksWall-clock Time (hours)ZO-MOPIModel=OPT-13BModel=OPT-13B2026.050.83ZO-MuonModel=OPT-13BModel=OPT-13B2026.052.35ZO-MOPIModel=LLaMA3-8BModel=LLaMA3-8B2026.052.68ZO-MuonModel=LLaMA3-8BModel=LLaMA3-8B2026.052.85LOZOModel=LLaMA3-8BModel=LLaMA3-8B2026.054.05MeZOModel=LLaMA3-8BModel=LLaMA3-8B2026.056.85LOZOModel=OPT-13BModel=OPT-13B2026.056.86MeZOModel=OPT-13BModel=OPT-13B2026.059.01