Language Modeling on OLMo-Mix (val)
18.54PerplexityArch-Warmup
Evaluation Results
| Method | Links | |
|---|---|---|
| Arch-WarmupModel Parameters=1B, Model Layers=16, Architecture=Transformer2026.06 | 18.54 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| Arch-WarmupModel Parameters=1B, Model Layers=16, Architecture=Transformer2026.06 | 18.54 |