Text Generation on 20 diverse prompts FineWeb 10BT derived (test)
0.974Distinct-1Token Maturation
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Token MaturationDecoding strategy=greedy, Max tokens=80, Number of prompts=202026.01 | 0.974 | 1 | 0 | 0 | 0 | |
| GPT-2Decoding strategy=greedy, Repetition penalty=1.1, Max tokens=80, Number of prompts=202026.01 | 0.936 | 0.999 | 0.001 | 0 | 0 | |
| GPT-2Decoding strategy=greedy, Max tokens=80, Number of prompts=202026.01 | 0.228 | 0.301 | 0.699 | 0.665 | 90 |