Language Modeling on HLE
Evaluation results
| Method | Links | |
|---|
| FullTraining Strategy=Full-Attention baseline2026.06 | | 1.275 |
|---|
| MSA-CPTTraining Strategy=sparse continued pretraining2026.06 | | 1.275 |
|---|
| MSA-PTTraining Strategy=from-scratch sparse pretraining2026.06 | | 1.278 |
|---|