Directed Text Generation on WIKI-AUTO (test)
45.26BLEU-2DIFFSEQ + Ours
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| DIFFSEQ + OursStep=20002023.05 | 45.26 | 37.33 | 48.35 | 59.82 | 2.04 | — | — | — | |
| Distance PenaltyStep=2000, Base Model=DIFFSEQ2023.05 | 45.26 | 37.33 | 48.35 | 59.28 | 2.04 | 2 | 81.88 | 96.76 | |
| Respace + OursStep=202023.05 | 44.61 | 36.51 | 47.61 | 58.81 | 3.29 | — | — | — | |
| Adaptive Decay SamplingStep=20, Base Model=DIFFSEQ2023.05 | 44.61 | 36.51 | 47.61 | 58.81 | 3.29 | 1.65 | 81.42 | 97.49 | |
| DIFFSEQStep=20002023.05 | 44.02 | 36.08 | 47.18 | 58.43 | 4.64 | — | — | — | |
| DIFFSEQStep=20002023.05 | 44.02 | 36.08 | 47.18 | 58.43 | 4.64 | 1.65 | 81.27 | 98.26 | |
| CMLM2023.05 | 43.12 | 35.26 | 47.59 | 58.46 | 2.74 | — | — | — | |
| CMLMStep=102023.05 | 43.12 | 35.26 | 47.59 | 58.46 | 2.74 | 2.94 | 81.83 | 98.19 | |
| BART2023.05 | 42.97 | 35.1 | 47.81 | 58.75 | 3.11 | — | — | — | |
| BART2023.05 | 42.97 | 35.1 | 47.81 | 58.75 | 3.11 | 2.22 | 81.98 | 98.38 | |
| RespaceStep=202023.05 | 42.13 | 33.97 | 45.33 | 57.05 | 17.44 | — | — | — | |
| RespaceStep=20, Base Model=DIFFSEQ2023.05 | 42.13 | 33.97 | 45.33 | 57.05 | 17.44 | 1.37 | 79.94 | 97.35 |