Summarization on SUMMZOO Average
13.97ROUGE-2UNISUMM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| UNISUMMFew-shot samples=1002022.11 | 13.97 | 38.84 | 28.52 | |
| MultiBARTFew-shot samples=1002022.11 | 13.58 | 38.03 | 28.04 | |
| PEGASUSFew-shot samples=1002022.11 | 12.22 | 36.94 | 26.79 | |
| UNISUMMFew-shot samples=102022.11 | 12.09 | 35.87 | 26.05 | |
| BART-PTFew-shot samples=1002022.11 | 11.82 | 35.84 | 26.2 | |
| GPT-3.5 (text-davinci-002)Few-shot samples=12022.11 | 10.96 | — | — | |
| MultiBARTFew-shot samples=102022.11 | 10.95 | 33.01 | 24.54 | |
| BART-FTFew-shot samples=1002022.11 | 9.67 | 32.66 | 23.85 | |
| PEGASUSFew-shot samples=102022.11 | 8.71 | 30.99 | 22.2 | |
| BART-PTFew-shot samples=102022.11 | 8.15 | 27.91 | 20.83 | |
| BART-FTFew-shot samples=102022.11 | 4.85 | 24.1 | 17.19 |