Conditional Generation on OpenWebText (Gen.PPL, Entropy, MAUVE)
24.11Generation Perplexity (Gen.PPL)IMDM
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| IMDMSteps=642026.05 | 24.11 | 3.97 | 0.97 | |
| IMDMSteps=322026.05 | 25.3 | 3.97 | 0.97 | |
| IMDMSteps=162026.05 | 27.48 | 3.97 | 0.97 | |
| IMDMSteps=82026.05 | 33.57 | 3.99 | 0.97 | |
| IMDMSteps=642026.05 | 36 | 4.02 | 97.3 | |
| IMDMSteps=322026.05 | 37.38 | 4.03 | 97.9 | |
| SDTTSteps=642026.05 | 37.94 | 4.05 | 0.97 | |
| Di4CSteps=642026.05 | 38.6 | 4.06 | 98.4 | |
| IMDMSteps=162026.05 | 41.31 | 4.03 | 97.9 | |
| Di4CSteps=322026.05 | 41.47 | 4.06 | 96.8 | |
| SDTTSteps=322026.05 | 41.5 | 4.05 | 0.96 | |
| SDTTSteps=642026.05 | 42.48 | 4.07 | 96.9 | |
| SDTTSteps=322026.05 | 45.99 | 4.07 | 97 | |
| Di4CSteps=162026.05 | 46.14 | 4.06 | 97.8 | |
| IMDMSteps=42026.05 | 48.24 | 3.98 | 0.95 | |
| SDTTSteps=162026.05 | 48.71 | 4.06 | 0.96 | |
| IMDMSteps=82026.05 | 49.28 | 4.04 | 97.4 | |
| SDTTSteps=162026.05 | 52.6 | 4.08 | 97.7 | |
| Di4CSteps=82026.05 | 61.05 | 4.08 | 97 | |
| SDTTSteps=82026.05 | 69.78 | 4.08 | 96.5 | |
| SDTTSteps=82026.05 | 70.29 | 4.06 | 0.92 | |
| IMDMSteps=42026.05 | 70.45 | 4.05 | 96.3 | |
| MDLMSteps=642026.05 | 71.55 | 4.13 | 0.96 | |
| MDLMSteps=642026.05 | 78 | 4.13 | 97.5 | |
| MDLMSteps=322026.05 | 80.16 | 4.12 | 0.96 | |
| IMDMSteps=22026.05 | 88.44 | 3.96 | 0.87 | |
| MDLMSteps=322026.05 | 90.09 | 4.14 | 96.2 | |
| Di4CSteps=42026.05 | 101.27 | 4.08 | 91 | |
| MDLMSteps=162026.05 | 102.63 | 4.13 | 0.96 | |
| MDLMSteps=162026.05 | 109.59 | 4.14 | 93.7 | |
| SDTTSteps=42026.05 | 117.19 | 4.08 | 86.4 | |
| SDTTSteps=42026.05 | 121.3 | 4.06 | 0.7 | |
| IMDMSteps=22026.05 | 132.26 | 4.06 | 81 | |
| MDLMSteps=82026.05 | 147.51 | 4.14 | 0.87 | |
| MDLMSteps=82026.05 | 157.39 | 4.15 | 86.2 | |
| Di4CSteps=22026.05 | 209.31 | 4.09 | 22.5 | |
| SDTTSteps=22026.05 | 209.98 | 4.05 | 0.09 | |
| SDTTSteps=22026.05 | 222.82 | 4.09 | 20.1 | |
| MDLMSteps=42026.05 | 241.2 | 4.14 | 0.39 | |
| MDLMSteps=42026.05 | 253.02 | 4.15 | 36.9 | |
| MDLMSteps=22026.05 | 368.7 | 4.13 | 0.05 | |
| MDLMSteps=22026.05 | 392.12 | 4.16 | 6.2 |