Single-Document Summarization on BIGPATENT (test)
76.87ROUGE-1LongT5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LongT5Model size=xl, Input length=16k, Attention mechanism=TGlobal2021.12 | 76.87 | 66.06 | 70.76 | — | |
| LongT5Model size=large, Input length=16k, Attention mechanism=TGlobal2021.12 | 70.38 | 56.81 | 62.73 | — | |
| BigBird-PEGASUSModel size=large, Backbone=PEGASUS2021.12 | 60.64 | 42.46 | 50.01 | — | |
| BARTSize=large, Parameter size=406M2021.05 | 45.83 | 19.53 | — | — | |
| BASSInput length=10242021.05 | 45.04 | 20.32 | 39.21 | 20.13 | |
| ROBERTaS2SBackbone=RoBERTa2021.05 | 43.62 | 18.62 | 37.86 | 18.18 | |
| ORACLE2021.05 | 43.56 | 16.91 | 36.52 | — | |
| Pegasus-baseSize=base, Parameter size=406M2021.05 | 43.55 | 20.43 | — | — | |
| FastAbs2021.05 | 37.12 | 11.87 | 32.45 | — | |
| TLM2021.05 | 36.41 | 11.38 | 30.88 | — | |
| LexRank2021.05 | 35.99 | 11.14 | 29.6 | — | |
| TransS2SArchitecture=Transformer-based encoder-decoder2021.05 | 34.93 | 9.86 | 29.92 | 9.42 | |
| Pointer+covMechanism=coverage mechanism2021.05 | 33.14 | 11.63 | 28.55 | — | |
| Lead2021.05 | 31.27 | 8.75 | 26.18 | — | |
| Pointer2021.05 | 30.59 | 10.01 | 25.65 | — | |
| Seq2SeqArchitecture=LSTM encoder-decoder with attention2021.05 | 28.74 | 7.87 | 24.66 | — |