Dialogue Summarization on SAMSum
29.88ROUGE-2PEGASUS-2B (calibrated)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PEGASUS-2B (calibrated)#params=2B, beam size=10, training=SLiC2022.09 | 29.88 | 54.37 | 45.89 | |
| ULL#params=20B2022.09 | 29.6 | — | — | |
| PEGASUS-2B (fine-tuned)#params=2B, beam size=52022.09 | 29.21 | 53.64 | 44.83 | |
| BART-FTtraining_mode=supervised finetuning2022.03 | 24.47 | 49.18 | 47.12 | |
| Narratorpre-training_data=DIANA, pre-training_task=GEN, training_mode=zero-shot2022.03 | 13.23 | 37.27 | 36.12 | |
| BARTtraining_mode=zero-shot2022.03 | 9.58 | 29.92 | 28.54 | |
| BART-DIAL-DEpre-training_data=DIAL, pre-training_task=DE, training_mode=zero-shot2022.03 | 9.52 | 30.08 | 29.36 | |
| BART-CRD3-GENpre-training_data=CRD3, pre-training_task=GEN, training_mode=zero-shot2022.03 | 9.09 | 27.07 | 27.64 | |
| BART-CNN-GENpre-training_data=CNN, pre-training_task=GEN, training_mode=zero-shot2022.03 | 9.08 | 31.33 | 28.03 | |
| GPT-2training_mode=zero-shot2022.03 | 0.74 | 10.83 | 11.68 |