Summarization on XSum (50 document sample)
40.9RL ScoreFROST
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FROSTDecoding Strategy=Single2022.03 | 40.9 | 0.31 | 0.75 | 0.37 | 2.63 | — | — | — | — | — | — | |
| PEGASUSDecoding Strategy=Single2022.03 | 40.69 | 0.51 | 0.76 | 0.4 | 2.52 | — | — | — | — | — | — | |
| Composition (FROST)Decoding Strategy=Diverse, Sampling=Composition Sampling2022.03 | 36.95 | 0.51 | 0.73 | 0.27 | 2.37 | 4.7 | 58.94 | 0.17 | 0.79 | 2.73 | 0.3 | |
| FAMEDecoding Strategy=Single2022.03 | 34.23 | — | 0.7 | 0.24 | 2.19 | — | — | — | — | — | — | |
| Composition (FROST++)Decoding Strategy=Diverse, Sampling=Composition Sampling2022.03 | 33.87 | 0.74 | 0.7 | 0.43 | 2.75 | 3.5 | 76.87 | 0.4 | 0.84 | 2.25 | 0.35 | |
| Nucleus (FROST)Decoding Strategy=Diverse2022.03 | 33.81 | 0.83 | 0.71 | 0.22 | 2.11 | 5 | 31.08 | 0.1 | 0.71 | 3.08 | 0.27 | |
| FROST++Decoding Strategy=Single2022.03 | 33.75 | 0.71 | 0.7 | 0.44 | 2.78 | — | — | — | — | — | — | |
| Nucleus (PEGASUS)Decoding Strategy=Diverse2022.03 | 31.1 | 1.47 | 0.68 | 0.24 | 2 | 5 | 26.22 | 0.1 | 0.68 | 3.11 | 0.3 | |
| Focus (FAME)Decoding Strategy=Diverse2022.03 | 29.19 | — | 0.66 | 0.23 | 1.88 | 2.6 | 89.51 | 0.62 | 0.91 | 1.84 | 0.09 |