Text Continuation on TinyStories 1K random samples (test)
39.7R-1TextLDM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| TextLDMModel Type=Continuous Diffusion, Number of Parameters=768M2026.05 | 39.7 | 10.4 | 23.4 | 85.8 | 1.51 | |
| TextLDMModel Type=Continuous Diffusion, Number of Parameters=328M2026.05 | 37.1 | 8.3 | 21.1 | 85.2 | 1.13 | |
| TextLDMModel Type=Continuous Diffusion, Number of Parameters=114M2026.05 | 36.7 | 7.8 | 20.7 | 84.8 | 1 | |
| GPT-2-largeModel Type=Autoregressive, Number of Parameters=774M2026.05 | 34.7 | 7.5 | 20.8 | 86.3 | 1.47 | |
| GPT-2-mediumModel Type=Autoregressive, Number of Parameters=355M2026.05 | 33.6 | 6.8 | 19.9 | 86.1 | 1.47 | |
| GPT-2Model Type=Autoregressive, Number of Parameters=137M2026.05 | 31.8 | 6.1 | 18.9 | 85.5 | 1.04 | |
| Block DiffusionModel Type=Discrete Diffusion, Number of Parameters=170M, block size=162026.05 | 31.8 | 5.3 | 18 | 85.1 | 1.2 | |
| Block DiffusionModel Type=Discrete Diffusion, Number of Parameters=170M, block size=82026.05 | 31 | 5 | 17.7 | 84.9 | 1 | |
| Block DiffusionModel Type=Discrete Diffusion, Number of Parameters=170M, block size=42026.05 | 28.5 | 4.4 | 16.6 | 84.4 | 1.1 | |
| SSD-LMModel Type=Continuous Diffusion, Number of Parameters=355M2026.05 | 28 | 3.7 | 16.6 | 83.7 | 0.78 |