Long Document Summarization on arXiv
48.47ROUGE-1 ScorePoolingFormer
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PoolingFormerInitialization=BART, Params=>406M2020.09 | 48.47 | 20.23 | |
| DeepPyramidionPretraining=None, Params=124M, Time Train=2.71, Time Infer=8.122020.09 | 47.15 | 19.99 | |
| BlockwisePretraining=None, Params=124M, Time Train=4.85, Time Infer=37.152020.09 | 46.85 | 19.39 | |
| HAT-BARTInitialization=BART, Params=>406M2020.09 | 46.74 | 19.19 | |
| BigBird-PEGASUSInitialization=RoBERTa, Params=568M2020.09 | 46.63 | 19.02 | |
| Dancer PEGASUSInitialization=PEGASUS, Params=568M2020.09 | 45.01 | 17.6 |