Abstractive Summarization on PubMed (test)
48.31ROUGE-1 (R-1)FACTORSUM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FACTORSUMBudget=Oracle, Content Guidance=Lead2022.05 | 48.31 | 19.99 | 44.35 | 208 | |
| HEPOS2022.05 | 48.12 | 21.06 | 42.72 | — | |
| FACTORSUMBudget=Fixed, Content Guidance=Model2022.05 | 47.5 | 20.33 | 43.76 | 205 | |
| FACTORSUMBudget=Oracle, Content Guidance=None2022.05 | 47.37 | 19.1 | 43.27 | 208 | |
| FACTORSUMBudget=Model, Content Guidance=Model2022.05 | 47.34 | 20.31 | 43.52 | 185 | |
| DANCER2022.05 | 46.34 | 19.97 | 42.42 | — | |
| FACTORSUMBudget=Fixed, Content Guidance=Lead2022.05 | 46.27 | 19.29 | 42.57 | 205 | |
| BigBird2022.05 | 45.48 | 19.92 | 41.81 | 185 | |
| FACTORSUMBudget=Fixed, Content Guidance=None2022.05 | 45.41 | 18.66 | 41.63 | 206 | |
| FACTORSUMBudget=Model, Content Guidance=None2022.05 | 44.64 | 17.98 | 40.76 | 185 | |
| PEGASUS2022.05 | 43.83 | 18.72 | 40.29 | 180 |