Language Modeling on OLMo-Mix (val)
18.54PerplexityArch-Warmup
Evaluation results
| Method | Links | |
|---|---|---|
| Arch-WarmupModel Parameters=1B, Model Layers=16, Architecture=Transformer2026.06 | 18.54 |
| Method | Links | |
|---|---|---|
| Arch-WarmupModel Parameters=1B, Model Layers=16, Architecture=Transformer2026.06 | 18.54 |