Language Modeling on IBW
51.45PerplexityMD4
Evaluation results
| Method | Links | |
|---|---|---|
| MD4Size=Medium, Zero-shot=true, Unconditional=true2024.06 | 51.45 | |
| GPT-2 (WebText)*Size=Medium, Zero-shot=true, Unconditional=true, Pretraining Dataset=WebText2024.06 | 55.72 | |
| SEDD AbsorbSize=Medium, Zero-shot=true, Unconditional=true2024.06 | 61.19 | |
| MD4Size=Small, Zero-shot=true, Unconditional=true2024.06 | 68.1 | |
| SEDD Absorb (reimpl.)Size=Small, Zero-shot=true, Unconditional=true2024.06 | 72.96 | |
| GPT-2 (WebText)*Size=Small, Zero-shot=true, Unconditional=true, Pretraining Dataset=WebText2024.06 | 75.2 | |
| SEDD AbsorbSize=Small, Zero-shot=true, Unconditional=true2024.06 | 79.29 | |
| PlaidSize=Small, Zero-shot=true, Unconditional=true2024.06 | 91.12 | |
| D3PMSize=Small, Zero-shot=true, Unconditional=true2024.06 | 138.92 |