ResearchBenchmarksScientific Reasoning on GPQA Hard (Accuracy)Scientific Reasoning on GPQA Hard (Accuracy)Follow26.3Accuracy (GPQA Hard)MSA-PT25.88425.99226.126.208Jun 11, 2026Evaluation resultsMethodMethodLinksAccuracy (GPQA Hard)MSA-PTTraining Strategy=from...Training Strategy=from-scratch sparse pretraining2026.0626.3MSA-CPTTraining Strategy=spar...Training Strategy=sparse continued pretraining2026.0626.3FullTraining Strategy=Full...Training Strategy=Full-Attention baseline2026.0625.9