Text Generation on OpenWebText (Generative Perplexity)
22.099Generative PerplexityParallel (Ours)
Evaluation results
| Method | Links | |
|---|---|---|
| Parallel (Ours)NFE=10242026.07 | 22.099 | |
| θ-TrapezoidalNFE=10242026.07 | 25.309 | |
| Parallel (Ours)NFE=5122026.07 | 25.876 | |
| τ-leapingNFE=10242026.07 | 30.762 | |
| Parallel (Ours)NFE=2562026.07 | 32.51 | |
| θ-TrapezoidalNFE=5122026.07 | 32.886 | |
| τ-leapingNFE=5122026.07 | 35.498 | |
| θ-TrapezoidalNFE=2562026.07 | 39.119 | |
| Parallel (Ours)NFE=1282026.07 | 40.701 | |
| τ-leapingNFE=2562026.07 | 41.88 | |
| Tweedie τ-leapingNFE=10242026.07 | 43.451 | |
| θ-TrapezoidalNFE=1282026.07 | 50.226 | |
| Parallel (Ours)NFE=642026.07 | 50.858 | |
| τ-leapingNFE=1282026.07 | 52.384 | |
| Tweedie τ-leapingNFE=5122026.07 | 53.922 | |
| τ-leapingNFE=642026.07 | 67.544 | |
| θ-TrapezoidalNFE=642026.07 | 68.587 | |
| Tweedie τ-leapingNFE=2562026.07 | 69.745 | |
| Parallel (Ours)NFE=322026.07 | 82.439 | |
| Tweedie τ-leapingNFE=1282026.07 | 83.922 | |
| θ-TrapezoidalNFE=322026.07 | 87.895 | |
| τ-leapingNFE=322026.07 | 94.918 | |
| Tweedie τ-leapingNFE=642026.07 | 108.431 | |
| FHSNFE=10242026.07 | 110.946 | |
| FHSNFE=2562026.07 | 111.959 | |
| FHSNFE=5122026.07 | 113.854 | |
| FHSNFE=1282026.07 | 124.335 | |
| FHSNFE=642026.07 | 140.42 | |
| Tweedie τ-leapingNFE=322026.07 | 160.466 | |
| FHSNFE=322026.07 | 188.653 |