Lay Summarization on PLOS (test)
57.82ROUGE-1Oracle
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| OracleMethod Category=Heuristic2024.06 | 57.82 | — | — | — | 23.92 | 53.37 | 87.13 | 11.2 | 15.28 | |
| ATLAS OracleMethod Category=Supervised, Attribute Setting=True Attribute Values (Gold)2024.06 | 44.97 | — | — | — | 12.49 | 41.02 | 85.82 | 11.21 | 14.48 | |
| ATLASMethod Category=Supervised, Attribute Setting=Average Observed Bin Value2024.06 | 44.41 | — | — | — | 14.16 | 41.12 | 86.55 | 10.36 | 13.32 | |
| BART ScaffoldMethod Category=Supervised2024.06 | 43.73 | — | — | — | 12.22 | 39.92 | 85.67 | 11.3 | 14.58 | |
| BARTMethod Category=Supervised2024.06 | 43.52 | — | — | — | 12.09 | 39.67 | 85.7 | 11.29 | 14.54 | |
| GPT3.5-mdcMethod Category=Supervised, Configuration=mdc2024.06 | 42.74 | — | — | — | 12.7 | 22.28 | 86.32 | 10.4 | 13.19 | |
| Lead-KMethod Category=Heuristic2024.06 | 38.28 | — | — | — | 9.45 | 34.8 | 83.72 | 11.88 | 14.95 | |
| HipoRankMethod Category=Unsup.2024.06 | 37.67 | — | — | — | 9.22 | 34.28 | 83.68 | 12.15 | 14.69 | |
| TextRankMethod Category=Unsup.2024.06 | 37.55 | — | — | — | 8.5 | 33.28 | 83.43 | 11.87 | 20.27 | |
| LexRankMethod Category=Unsup.2024.06 | 31.2 | — | — | — | 9.09 | 28.72 | 82.97 | 9.7 | 14.59 | |
| Lead-3Method Category=Heuristic2024.06 | 27.41 | — | — | — | 6.87 | 24.61 | 83.36 | 12.66 | 15.08 | |
| ATLAS2024.06 | — | 2.55 | 2.45 | 2.4 | — | — | — | — | — | |
| BART2024.06 | — | 2 | 2.1 | 2.05 | — | — | — | — | — |