Text Summarization Evaluation on NeR 18
0.701Spearman Corr (COH)BARTSCORE-PROMPT
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BARTSCORE-PROMPTPrompting=true2021.06 | 0.701 | 0.679 | 0.686 | 0.62 | 0.518 | |
| BARTSCORE2021.06 | 0.679 | 0.67 | 0.646 | 0.604 | 0.465 | |
| BARTSCORE-CNN-PARAFine-tuning data=CNN + Paraphrase2021.06 | 0.657 | 0.652 | 0.614 | 0.562 | 0.497 | |
| BARTSCORE-CNNFine-tuning data=CNN/Daily Mail2021.06 | 0.653 | 0.64 | 0.616 | 0.567 | 0.499 | |
| PRISM2021.06 | 0.573 | 0.532 | 0.561 | 0.553 | 0.41 | |
| BERTScore2021.06 | 0.147 | 0.17 | 0.131 | 0.163 | 0.217 | |
| MoverScore2021.06 | 0.12 | 0.188 | 0.195 | 0.2 | 0.2 | |
| ROUGE-12021.06 | 0.095 | 0.104 | 0.13 | 0.147 | 0.194 | |
| ROUGE-L2021.06 | 0.064 | 0.072 | 0.089 | 0.106 | 0.164 | |
| ROUGE-22021.06 | 0.026 | 0.048 | 0.079 | 0.091 | 0.165 |