Language Modeling on SWE
Evaluation results
| Method | Links | |
|---|
| FullTraining Strategy=Full-Attention baseline2026.06 | | 1.216 |
|---|
| MSA-CPTTraining Strategy=sparse continued pretraining2026.06 | | 1.216 |
|---|
| MSA-PTTraining Strategy=from-scratch sparse pretraining2026.06 | | 1.218 |
|---|