Unconditional Text Generation on OpenWebText (test)
692.3LLAMA2 ScoreD3PM Absorb
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| D3PM AbsorbTimesteps=10242024.10 | 692.3 | 754.9 | 842.3 | 7.6 | |
| Ssd-LMTimesteps=>100002024.10 | 73.3 | 203.1 | 99.2 | 4.8 | |
| MDLMTimesteps=2562024.10 | 37.2 | 66.8 | 66.8 | 7.9 | |
| SEDDTimesteps=2562024.10 | 36.1 | 65 | 64.8 | 7.8 | |
| EDLM-NCETimesteps=2562024.10 | 35.7 | 62.9 | 61.7 | 7.9 | |
| EDLM-ARTimesteps=2562024.10 | 34.7 | 62.2 | 62.1 | 7.9 | |
| SEDDTimesteps=5122024.10 | 32.5 | 54.3 | 52.2 | 7.7 | |
| MDLMTimesteps=5122024.10 | 30.6 | 52.6 | 52.4 | 7.8 | |
| SUNDAETimesteps=2002024.10 | 29.5 | 45.1 | 34.7 | 5.2 | |
| MDLMTimesteps=10242024.10 | 27.6 | 44.6 | 42.6 | 7.6 | |
| SEDDTimesteps=10242024.10 | 27.3 | 43.7 | 41.5 | 7.6 | |
| EDLM-ARTimesteps=5122024.10 | 26.8 | 44.4 | 42 | 7.6 | |
| EDLM-NCETimesteps=5122024.10 | 26.3 | 44.1 | 42.5 | 7.6 | |
| MDLMTimesteps=20482024.10 | 23.9 | 37.6 | 34.9 | 7.5 | |
| SEDDTimesteps=20482024.10 | 23.1 | 36.2 | 33.7 | 7.5 | |
| AutoregressiveTimesteps=10242024.10 | 22.9 | 40.3 | 35.7 | 8.1 | |
| EDLM-ARTimesteps=10242024.10 | 19.6 | 28.8 | 25.5 | 7.2 | |
| EDLM-NCETimesteps=10242024.10 | 19 | 28.8 | 25.5 | 7.3 | |
| EDLM-ARTimesteps=20482024.10 | 14.6 | 20.8 | 17.9 | 6.9 | |
| EDLM-NCETimesteps=20482024.10 | 14.6 | 20.7 | 17.7 | 6.9 | |
| Data2024.10 | 7 | 9.4 | 14.7 | 7.7 |