Summarization on BookSum Chapter Level
42.68ROUGE-1Extractive Oracle
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Extractive Oracle2022.03 | 42.68 | 9.66 | 21.33 | |
| Top Down TransformerPooling strategy=OracleAdaPool2022.03 | 41.1 | 9.49 | 19.19 | |
| BART-LS# Param=440M2022.09 | 38.5 | 10.3 | 36.4 | |
| Top Down TransformerPooling strategy=AdaPool, Number of parameters=464M2022.03 | 38.34 | 9.19 | 18.08 | |
| Top-down (AdaP)# Param=660M*2022.09 | 38.3 | 9.2 | 18.1 | |
| Top Down TransformerPooling strategy=AvgPool, Number of parameters=464M2022.03 | 37.99 | 9.1 | 18.02 | |
| Top-down (AvgP)# Param=460M2022.09 | 37.9 | 9.1 | 18 | |
| T5Number of parameters=738M2022.03 | 37.38 | 8.42 | 16.77 | |
| BARTNumber of parameters=406M2022.03 | 37.09 | 8.23 | 15.37 | |
| PegasusNumber of parameters=568M2022.03 | 36.17 | 7.79 | 16.09 | |
| LongformerNumber of parameters=460M2022.03 | 32.84 | 7.45 | 14.59 | |
| LED# Param=460M2022.09 | 32.8 | 7.5 | 14.6 | |
| BigBird# Param=580M2022.09 | 31.8 | 6.5 | 14.2 | |
| BigBirdNumber of parameters=577M2022.03 | 31.78 | 6.5 | 14.17 |