Unconditional generation on LM1B sequence length 128
40.2Generation Perplexity (PPL)Real texts
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Real texts2026.05 | 40.2 | 100 | 62.3 | 4.37 | |
| Duo + Ψ-samplerSteps (NFE)=1024, p=0.9, eta=0.052026.05 | 56.2 | 92.6 | 55.2 | 4.32 | |
| LDLMSteps (NFE)=10242026.05 | 57.4 | 89.2 | 53.8 | 4.36 | |
| Duo + Ψ-samplerSteps (NFE)=512, p=0.9, eta=0.052026.05 | 60.3 | 93.3 | 55.7 | 4.33 | |
| LDLMSteps (NFE)=5122026.05 | 63 | 91.3 | 55.4 | 4.37 | |
| Duo + Ψ-samplerSteps (NFE)=256, p=0.9, eta=0.052026.05 | 64.1 | 92 | 56.1 | 4.32 | |
| ReMDM (rescale)Steps (NFE)=1024, p=0.92026.05 | 64.8 | 91.5 | 57.2 | 4.34 | |
| LDLMSteps (NFE)=2562026.05 | 68.3 | 92.7 | 56.7 | 4.37 | |
| Duo + Ψ-samplerSteps (NFE)=128, p=0.9, eta=0.052026.05 | 68.4 | 92.7 | 56.3 | 4.33 | |
| Duo + Ψ-samplerSteps (NFE)=64, p=0.9, eta=0.052026.05 | 71.1 | 92 | 56.5 | 4.32 | |
| ReMDM (rescale)Steps (NFE)=512, p=0.92026.05 | 73.7 | 91.6 | 58.3 | 4.34 | |
| Duo + Ψ-samplerSteps (NFE)=32, p=0.9, eta=0.052026.05 | 75 | 89.6 | 56.2 | 4.32 | |
| LDLMSteps (NFE)=1282026.05 | 79.2 | 93.8 | 58.8 | 4.38 | |
| ReMDM (rescale)Steps (NFE)=256, p=0.92026.05 | 84.3 | 90.4 | 59.6 | 4.35 | |
| MDLMSteps (NFE)=10242026.05 | 97.5 | 90.1 | 57.8 | 4.34 | |
| ReMDM (rescale)Steps (NFE)=128, p=0.92026.05 | 98.7 | 91.9 | 60.9 | 4.35 | |
| LDLMSteps (NFE)=642026.05 | 99.1 | 93.7 | 62 | 4.39 | |
| MDLMSteps (NFE)=5122026.05 | 109.7 | 88.6 | 59.7 | 4.35 | |
| ReMDM (rescale)Steps (NFE)=64, p=0.92026.05 | 117.4 | 88.5 | 62.1 | 4.36 | |
| MDLMSteps (NFE)=2562026.05 | 123.8 | 89.3 | 61.4 | 4.36 | |
| DuoSteps (NFE)=10242026.05 | 130.8 | 88.9 | 62.7 | 4.36 | |
| DuoSteps (NFE)=5122026.05 | 132.7 | 91.7 | 63 | 4.37 | |
| DuoSteps (NFE)=2562026.05 | 133.1 | 90.4 | 62.7 | 4.37 | |
| DuoSteps (NFE)=1282026.05 | 136.3 | 90.6 | 62.9 | 4.36 | |
| MDLMSteps (NFE)=1282026.05 | 139.2 | 89.1 | 63 | 4.37 | |
| DuoSteps (NFE)=642026.05 | 139.5 | 88.8 | 62.7 | 4.37 | |
| FLMSteps (NFE)=10242026.05 | 142.5 | 64.2 | 54.5 | 4.36 | |
| FLMSteps (NFE)=5122026.05 | 147.1 | 62.8 | 54.9 | 4.37 | |
| ReMDM (rescale)Steps (NFE)=32, p=0.92026.05 | 148.4 | 84.2 | 63.5 | 4.36 | |
| DuoSteps (NFE)=322026.05 | 148.4 | 84.5 | 62.7 | 4.36 | |
| LDLMSteps (NFE)=322026.05 | 154.1 | 75.2 | 67.3 | 4.42 | |
| FLMSteps (NFE)=2562026.05 | 154.5 | 65.3 | 55.7 | 4.38 | |
| MDLMSteps (NFE)=642026.05 | 161.2 | 79.6 | 64.5 | 4.38 | |
| FLMSteps (NFE)=1282026.05 | 167.8 | 61.1 | 56.8 | 4.4 | |
| CANDISteps (NFE)=10242026.05 | 167.9 | 89 | 65.6 | 4.4 | |
| CANDISteps (NFE)=5122026.05 | 172.8 | 87.9 | 65.8 | 4.4 | |
| CANDISteps (NFE)=2562026.05 | 173.9 | 87.7 | 65.7 | 4.41 | |
| CANDISteps (NFE)=1282026.05 | 182.3 | 88.5 | 65.9 | 4.41 | |
| FLMSteps (NFE)=642026.05 | 188.8 | 52.7 | 58.6 | 4.42 | |
| MDLMSteps (NFE)=322026.05 | 196.9 | 73.3 | 66.1 | 4.38 | |
| CANDISteps (NFE)=642026.05 | 199.2 | 86.4 | 66.6 | 4.41 | |
| FLMSteps (NFE)=322026.05 | 226.9 | 41.8 | 61 | 4.45 | |
| CANDISteps (NFE)=322026.05 | 235.8 | 81.6 | 67.5 | 4.41 |