Open-ended generation on Wikitext-103 (test)
0.96MAUVEDITTO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DITTOSearch=Top-k (k=50)2022.06 | 0.96 | 1 | 0.09 | |
| DITTOSearch=Nucleus (top-p p=0.9)2022.06 | 0.96 | 0.98 | 0.08 | |
| UL-tokenSearch=Top-k (k=50)2022.06 | 0.95 | 0.7 | 0 | |
| MLESearch=Top-k (k=50)2022.06 | 0.94 | 1.6 | 0.25 | |
| MLESearch=Nucleus (top-p p=0.9)2022.06 | 0.94 | 1.4 | 0.08 | |
| UL-tokenSearch=Nucleus (top-p p=0.9)2022.06 | 0.94 | 0.47 | 0 | |
| UL-token+seqSearch=Nucleus (top-p p=0.9)2022.06 | 0.94 | 0.08 | 0.02 | |
| UL-token+seqSearch=Top-k (k=50)2022.06 | 0.93 | 0.09 | 0.06 | |
| SGSearch=Top-k (k=50)2022.06 | 0.93 | 0.5 | 0 | |
| SGSearch=Nucleus (top-p p=0.9)2022.06 | 0.93 | 0.4 | 0.06 | |
| FoSSDecoding Strategy=Nucleus2026.02 | 0.3165 | — | — | |
| FoSSDecoding Strategy=Greedy2026.02 | 0.3078 | — | — | |
| GFlowNets-FTDecoding Strategy=Nucleus2026.02 | 0.2961 | — | — | |
| GFlowNets-FTDecoding Strategy=Greedy2026.02 | 0.2658 | — | — | |
| CoGDecoding Strategy=Nucleus2026.02 | 0.2614 | — | — | |
| CoGDecoding Strategy=Greedy2026.02 | 0.2601 | — | — | |
| GDVDecoding Strategy=Greedy2026.02 | 0.2569 | — | — | |
| GDVDecoding Strategy=Nucleus2026.02 | 0.2434 | — | — | |
| Transformer w/ FTDecoding Strategy=Nucleus2026.02 | 0.2343 | — | — | |
| RETRODecoding Strategy=Nucleus2026.02 | 0.2286 | — | — | |
| kNN-LMDecoding Strategy=Nucleus2026.02 | 0.225 | — | — | |
| Transformer w/o FTDecoding Strategy=Nucleus2026.02 | 0.2237 | — | — | |
| RETRODecoding Strategy=Greedy2026.02 | 0.2119 | — | — | |
| kNN-LMDecoding Strategy=Greedy2026.02 | 0.1992 | — | — | |
| Transformer w/ FTDecoding Strategy=Greedy2026.02 | 0.1987 | — | — | |
| Transformer w/o FTDecoding Strategy=Greedy2026.02 | 0.1864 | — | — | |
| HumanSearch=N/A2022.06 | — | 1.1 | 0.1 |