Language Modeling on The Pile PubMed Central (test)
7.25PPLSplit Model
Evaluation Results
| Method | Links | |
|---|---|---|
| Split ModelModel structure=Split, Total compute budget=720B tokens, Number of parameters=1.3B, ts=340B2026.03 | 7.25 | |
| Standalone Pretrained ModelModel structure=Standalone, Total compute budget=720B tokens, Number of parameters=1.3B2026.03 | 7.9 |