Summarization on PLOS and eLife combined (test)
60.08ROUGE-1Oracle
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| OracleMethod Category=Heuristic2024.06 | 60.08 | 27.48 | 55.95 | 87.35 | 11.12 | 15.15 | |
| ATLAS OracleMethod Category=Supervised, Attribute Setting=True Attribute Values (Gold)2024.06 | 46.11 | 14.07 | 42.51 | 85.69 | 10.99 | 14.13 | |
| ATLASMethod Category=Supervised, Attribute Setting=Average Observed Bin Value2024.06 | 45.87 | 14.08 | 42.32 | 85.54 | 10.96 | 14.21 | |
| BARTMethod Category=Supervised2024.06 | 43.34 | 13.14 | 39.8 | 85.48 | 11.33 | 14.4 | |
| BART ScaffoldMethod Category=Supervised2024.06 | 43.13 | 12.87 | 39.66 | 85.33 | 11.1 | 14.14 | |
| TextRankMethod Category=Unsup.2024.06 | 40.26 | 11.53 | 36.02 | 83.83 | 11.78 | 20.08 | |
| LexRankMethod Category=Unsup.2024.06 | 38.22 | 13.06 | 35.42 | 83.85 | 9.7 | 14.23 | |
| HipoRankMethod Category=Unsup.2024.06 | 36.95 | 10.19 | 33.89 | 83.22 | 12.15 | 14.46 | |
| Lead-KMethod Category=Heuristic2024.06 | 35.69 | 9.07 | 32.7 | 82.86 | 11.69 | 14.49 | |
| Lead-3Method Category=Heuristic2024.06 | 23.86 | 5.66 | 21.48 | 81.17 | 12.66 | 14.82 |