Language Modeling on TAU2
Evaluation results
| Method | Links | |
|---|
| MSA-PTTraining Strategy=from-scratch sparse pretraining2026.06 | | 1.148 |
|---|
| MSA-CPTTraining Strategy=sparse continued pretraining2026.06 | | 1.15 |
|---|
| FullTraining Strategy=Full-Attention baseline2026.06 | | 1.155 |
|---|