Email Subject Line Generation on AESLC (test)
36.19ROUGE-1Human Annotation
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Human AnnotationReference=Two human annotations2019.06 | 36.19 | 17.75 | 33.5 | 21.42 | |
| Our SystemReference=Two human annotations2019.06 | 26.11 | 11.43 | 25.64 | 13.52 | |
| Original SubjectReference=Two human annotations2019.06 | 24.57 | 10.4 | 23.15 | 14.08 | |
| Human Annotation2019.06 | 23.9 | 10.09 | 22.75 | 11.04 | |
| ESQE2019.06 | 23.67 | 10.29 | 23.44 | 9.37 | |
| See et al.Reference=Two human annotations, Year=20172019.06 | 23.31 | 7.28 | 20.83 | 15.68 | |
| Hsu et al.Reference=Two human annotations, Year=20182019.06 | 22.8 | 7.09 | 19.85 | 18.45 | |
| LexRankReference=Two human annotations2019.06 | 20.84 | 9.57 | 18.68 | 19.97 | |
| LEAD-2Reference=Two human annotations2019.06 | 18.29 | 8.54 | 16.62 | 20.23 | |
| TextRankReference=Two human annotations2019.06 | 17.93 | 7.47 | 16 | 16.98 | |
| See et al. (2017)2019.06 | 17.02 | 5.45 | 15.78 | 10.31 | |
| Shang et al.Reference=Two human annotations, Year=20182019.06 | 16.11 | 5.5 | 14.88 | 11.81 | |
| Hsu et al. (2018)2019.06 | 15.75 | 4.54 | 14.41 | 12.49 | |
| Paulus et al.Reference=Two human annotations, Year=20182019.06 | 14.56 | 4.39 | 13.53 | 10.37 | |
| Paulus et al. (2018)2019.06 | 13.49 | 4.55 | 12.83 | 8.65 | |
| Narayan et al. (2018a)2019.06 | 12.6 | 3.09 | 12.52 | 4.66 | |
| LexRank2019.06 | 12.46 | 4.62 | 11.37 | 11.56 | |
| Narayan et al.Reference=Two human annotations, Year=2018a2019.06 | 11.53 | 1.37 | 11.4 | 5.04 | |
| TextRank2019.06 | 11.32 | 3.88 | 10.14 | 10.64 | |
| LEAD-22019.06 | 11 | 4.33 | 10.2 | 11.27 | |
| Shang et al. (2018)2019.06 | 10.4 | 3.09 | 9.77 | 6.15 |