Language Modeling on General Domain (holdout test)
0.79L_inf8B Model
Evaluation results
| Method | Links | ||
|---|---|---|---|
| 8B ModelModel Scale=8B2026.02 | 0.79 | 0.02 | |
| 4B ModelModel Scale=4B2026.02 | 0.82 | 0.026 | |
| 1.7B ModelModel Scale=1.7B2026.02 | 0.87 | 0.023 | |
| 0.6B ModelModel Scale=0.6B2026.02 | 0.96 | 0.027 |