Unconditional Text Generation on OpenWebText (held-out segments)
1MAUVE*Data
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| *DataSampling steps=5122025.11 | 1 | 7 | 9.4 | 14.8 | 5.44 | |
| ARSampling steps=5122025.11 | 0.855 | 10.97 | 15.12 | 12.07 | 5.21 | |
| KLASSSampling steps=5122025.11 | 0.179 | 26.94 | 49.19 | 45.5 | 5.43 | |
| MDLMSampling steps=5122025.11 | 0.115 | 30.88 | 54.15 | 51.78 | 5.46 | |
| SEDDSampling steps=5122025.11 | 0.037 | 53.09 | 109.6 | 105.4 | 5.62 | |
| D3PMSampling steps=5122025.11 | 0.022 | 41.82 | 72.85 | 76.7 | 5.4 |