Text Generation on LM1B
68.11Perplexity (PPL)DFM (ESD)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DFM (ESD)NFEs=12026.04 | 68.11 | 3.79 | |
| DFM (ESD)NFEs=42026.04 | 71.53 | 4.13 | |
| DFM (ESD)NFEs=22026.04 | 77.6 | 4.11 | |
| DFM (PSD)NFEs=42026.04 | 78.89 | 4.1 | |
| DFM (PSD)NFEs=22026.04 | 87.42 | 4.08 | |
| DFM (PSD)NFEs=12026.04 | 94.08 | 4.06 | |
| FMLMNFEs=42026.04 | 98.76 | 4.21 | |
| FMLMNFEs=22026.04 | 110.19 | 4.21 | |
| FMLMNFEs=12026.04 | 119.34 | 4.16 | |
| Duo + Di4CNFEs=42026.04 | 150.67 | 4 | |
| Duo + DCDNFEs=42026.04 | 210.88 | 4.23 | |
| MDLM + SDTTNFEs=42026.04 | 241.01 | 4.28 | |
| MDLM + Di4CNFEs=42026.04 | 247.32 | 4 | |
| VADD+TTD (Ours)Timesteps=162026.07 | 247.4 | 6.96 | |
| Duo + Di4CNFEs=22026.04 | 247.69 | 3.87 | |
| VADD+CPD (Ours)Timesteps=162026.07 | 249.77 | 6.93 | |
| VADDTimesteps=162026.07 | 251.03 | 6.93 | |
| CFMNFEs=22026.04 | 267.39 | 3.15 | |
| CFMNFEs=42026.04 | 267.97 | 3.28 | |
| CFMNFEs=12026.04 | 269.72 | 3.1 | |
| VADD+TTD (Ours)Timesteps=82026.07 | 284.86 | 6.95 | |
| Duo + Di4CNFEs=12026.04 | 292.94 | 3.79 | |
| VADD+CPD (Ours)Timesteps=82026.07 | 298.66 | 6.93 | |
| VADDTimesteps=82026.07 | 299.39 | 6.93 | |
| VADD+TTD (Ours)Timesteps=42026.07 | 369.56 | 6.94 | |
| VADDTimesteps=42026.07 | 414.02 | 6.9 | |
| VADD+CPD (Ours)Timesteps=42026.07 | 419.69 | 6.9 | |
| Duo + DCDNFEs=22026.04 | 520.08 | 4.2 | |
| VADD+TTD (Ours)Timesteps=22026.07 | 532.43 | 6.93 | |
| MDLM + SDTTNFEs=22026.04 | 602.14 | 4.28 | |
| MDLM + Di4CNFEs=22026.04 | 621.59 | 4.37 | |
| VADD+CPD (Ours)Timesteps=22026.07 | 659.87 | 6.9 | |
| VADDTimesteps=22026.07 | 664.16 | 6.9 | |
| VADD+TTD (Ours)Timesteps=12026.07 | 850.64 | 6.99 | |
| VADDTimesteps=12026.07 | 1,096.39 | 6.94 | |
| VADD+CPD (Ours)Timesteps=12026.07 | 1,099.93 | 6.95 | |
| MDLM + Di4CNFEs=12026.04 | 1,217.1 | 4.38 | |
| Duo + DCDNFEs=12026.04 | 1,224.52 | 4.33 | |
| MDLM + SDTTNFEs=12026.04 | 1,429.48 | 4.31 |