Language Modeling on LM1B GPT-2 small model size equivalent (test)
20.53PerplexityVADD
Evaluation results
| Method | Links | |
|---|---|---|
| VADDModel Category=Diffusion, #Iterations=1M2025.05 | 20.53 | |
| TransformerModel Category=Auto-Regressive, #Iterations=5M, Source=Reported in Sahoo et al. (2024)2025.05 | 20.86 | |
| OmniNetTModel Category=Auto-Regressive, #Iterations=-2025.05 | 21.5 | |
| TransformerModel Category=Auto-Regressive, #Iterations=0.5M, Source=Reported in Sahoo et al. (2024)2025.05 | 22.32 | |
| MDLMModel Category=Diffusion, #Iterations=10M, Source=Reported in Sahoo et al. (2024)2025.05 | 23 | |
| Transformer-XLModel Category=Auto-Regressive, #Iterations=-2025.05 | 23.5 | |
| MDLMModel Category=Diffusion, #Iterations=1M, Source=Reported in Sahoo et al. (2024)2025.05 | 27.04 | |
| MDLMModel Category=Diffusion, #Iterations=1M, Source=Reproduced by current authors2025.05 | 27.7 | |
| SEDD-AbsorbModel Category=Diffusion, #Iterations=1M2025.05 | 32.79 | |
| DiffusionBertModel Category=Diffusion, #Iterations=1.9M2025.05 | 63.78 |