Conditional Generation on OWT (OpenWebText)
19.99Perplexity (PPL)DID
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DIDPrompt Length=768, Steps=10242026.03 | 19.99 | 7.86 | 1,024.1 | |
| DIDPrompt Length=768, Steps=2562026.03 | 20.1 | 7.87 | 1,023.93 | |
| DIDPrompt Length=768, Steps=642026.03 | 20.25 | 7.86 | 1,023.38 | |
| DIDPrompt Length=768, Steps=162026.03 | 21.64 | 7.83 | 1,011.45 | |
| RADDPrompt Length=768, Steps=10242026.03 | 21.8 | 7.84 | — | |
| RADDPrompt Length=768, Steps=2562026.03 | 21.92 | 7.84 | — | |
| RADDPrompt Length=768, Steps=642026.03 | 22.57 | 7.84 | — | |
| RADDPrompt Length=768, Steps=162026.03 | 25.85 | 7.85 | — | |
| DIDPrompt Length=512, Steps=10242026.03 | 29 | 7.9 | 1,024.07 | |
| DIDPrompt Length=512, Steps=2562026.03 | 29.19 | 7.91 | 1,023.99 | |
| DIDPrompt Length=512, Steps=642026.03 | 29.95 | 7.9 | 1,023.08 | |
| RADDPrompt Length=512, Steps=10242026.03 | 35.11 | 7.96 | — | |
| DIDPrompt Length=512, Steps=162026.03 | 35.29 | 7.86 | 1,018.66 | |
| RADDPrompt Length=512, Steps=2562026.03 | 35.51 | 7.95 | — | |
| RADDPrompt Length=512, Steps=642026.03 | 38.17 | 7.95 | — | |
| DIDPrompt Length=256, Steps=2562026.03 | 47.47 | 7.92 | 1,023.88 | |
| DIDPrompt Length=256, Steps=10242026.03 | 48.85 | 7.92 | 1,024 | |
| DIDPrompt Length=256, Steps=642026.03 | 50.98 | 7.94 | 1,023.81 | |
| RADDPrompt Length=512, Steps=162026.03 | 52.31 | 8 | — | |
| RADDPrompt Length=256, Steps=10242026.03 | 55.16 | 8.01 | — | |
| RADDPrompt Length=256, Steps=2562026.03 | 58.33 | 8.03 | — | |
| RADDPrompt Length=256, Steps=642026.03 | 67.13 | 8.03 | — | |
| DIDPrompt Length=256, Steps=162026.03 | 70.11 | 7.92 | 1,022.48 | |
| RADDPrompt Length=256, Steps=162026.03 | 114.46 | 8.12 | — |