Language generation on OpenWebText (val)
14.2OLMo PerplexityDGLM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DGLMPrefix Guidance (w)=52024.08 | 14.2 | 84 | 52.6 | |
| DGLMPrefix Guidance (w)=32024.08 | 14.7 | 84.5 | 52.5 | |
| DGLMPrefix Guidance (w)=2.52024.08 | 15 | 83.7 | 52.4 | |
| DGLMPrefix Guidance (w)=22024.08 | 15.4 | 83.1 | 52.1 | |
| DGLMPrefix Guidance (w)=1.52024.08 | 17.1 | 82.8 | 51.4 | |
| Reference2024.08 | 17.2 | — | 57.6 | |
| GPT-2Large2024.08 | 17.6 | 88.2 | 49.2 | |
| DGLMPrefix Guidance (w)=12024.08 | 22.9 | 78.6 | 50.2 |