Dialogue Summarization on Email (test)
28.9ROUGE-1 ScoreDIONYSUS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DIONYSUSModel Size=Large, Evaluation Protocol=Zero-shot, Strategy=Better ROUGE2022.12 | 28.9 | 7.7 | 18 | |
| DIONYSUSModel Size=Large, Evaluation Protocol=Zero-shot, Strategy=All G2022.12 | 26.4 | 7.1 | 17.2 | |
| DIONYSUSModel Size=Large, Evaluation Protocol=Zero-shot, Strategy=All P2022.12 | 24.3 | 5.5 | 15.8 | |
| PEGASUSModel Size=Large, Evaluation Protocol=Zero-shot2022.12 | 23.9 | 5.7 | 15.3 | |
| GSG+Evaluation Protocol=Zero-shot2022.12 | 21 | 4.2 | 15.9 | |
| T5v1.1Model Size=Large, Evaluation Protocol=Zero-shot2022.12 | 14.9 | 2.7 | 11.1 |