List your company

Language Modeling on AgentCompany

1.247PerplexityMSA-CPT
1.246921.247461.2481.24854Jun 11, 2026

Evaluation results

MethodLinks
MSA-CPTTraining Strategy=sparse continued pretraining2026.061.247
FullTraining Strategy=Full-Attention baseline2026.061.248
MSA-PTTraining Strategy=from-scratch sparse pretraining2026.061.249