Unconditional Text Generation on LM1B
4.29EntropyMDLM
Evaluation results
| Method | Links | |
|---|---|---|
| MDLMSteps=2, Distillation Method=ReDi2026.05 | 4.29 | |
| MDLMSteps=4, Distillation Method=ReDi2026.05 | 4.27 | |
| MDLMSteps=8, Distillation Method=ReDi2026.05 | 4.27 | |
| MDLMSteps=16, Distillation Method=SDTT2026.05 | 4.27 | |
| MDLMSteps=8, Distillation Method=SDTT2026.05 | 4.26 | |
| IMDMSteps=8, Distillation Method=ReDi2026.05 | 4.26 | |
| MDLMSteps=16, Distillation Method=ReDi2026.05 | 4.26 | |
| IMDMSteps=16, Distillation Method=ReDi2026.05 | 4.26 | |
| MDLMSteps=2, Distillation Method=SDTT2026.05 | 4.25 | |
| MDLMSteps=2, Distillation Method=SDTT + ReDi2026.05 | 4.25 | |
| MDLMSteps=4, Distillation Method=SDTT2026.05 | 4.25 | |
| IMDMSteps=4, Distillation Method=ReDi2026.05 | 4.25 | |
| IMDMSteps=8, Distillation Method=SDTT2026.05 | 4.25 | |
| IMDMSteps=16, Distillation Method=SDTT2026.05 | 4.25 | |
| IMDMSteps=2, Distillation Method=SDTT2026.05 | 4.24 | |
| IMDMSteps=2, Distillation Method=ReDi2026.05 | 4.24 | |
| IMDMSteps=4, Distillation Method=SDTT2026.05 | 4.24 | |
| MDLMSteps=4, Distillation Method=SDTT + ReDi2026.05 | 4.22 | |
| MDLMSteps=8, Distillation Method=SDTT + ReDi2026.05 | 4.22 | |
| MDLMSteps=16, Distillation Method=SDTT + ReDi2026.05 | 4.21 | |
| IMDMSteps=8, Distillation Method=SDTT + ReDi2026.05 | 4.2 | |
| IMDMSteps=16, Distillation Method=SDTT + ReDi2026.05 | 4.2 | |
| IMDMSteps=4, Distillation Method=SDTT + ReDi2026.05 | 4.19 | |
| IMDMSteps=2, Distillation Method=SDTT + ReDi2026.05 | 4.15 |