Text Generation on Wikinews
77.1Coherence: CD PreferredContrastive Decoding
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Contrastive DecodingCD Model=GPT-2 XL, Baseline Decoding Strategy=typical, Baseline Model=GPT-2 XL2022.10 | 77.1 | 15.1 | 7.8 | 75.5 | 15.1 | 9.4 | |
| Contrastive DecodingCD Model=GPT-2 XL, Baseline Decoding Strategy=nucleus, Baseline Model=GPT-2 XL2022.10 | 70.8 | 4.2 | 25 | 58.3 | 12 | 29.7 | |
| Contrastive DecodingCD Model=OPT-13B, Baseline Decoding Strategy=typical, Baseline Model=OPT-13B2022.10 | 69.3 | 9.9 | 20.8 | 49 | 29.7 | 21.4 | |
| Contrastive DecodingCD Model=OPT-13B, Baseline Decoding Strategy=nucleus, Baseline Model=OPT-13B2022.10 | 58.5 | 22.1 | 19.5 | 51.8 | 12.3 | 35.9 |