Long-document Summarization on ArXiv (test)
22.5ROUGE-2 ScoreZ-Code++_LARGE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Z-Code++_LARGENumber of Parameters=710M2022.08 | 22.5 | — | — | — | |
| BART-LS# Param=440M2022.09 | 22.1 | 50.2 | 45.4 | — | |
| LongT5-xl# Param=3B2022.09 | 21.9 | 48.4 | 44.3 | — | |
| Top-down (AdaP)# Param=660M*2022.09 | 21.9 | 51 | 45.6 | — | |
| Top-Down Transformer2022.08 | 21.9 | — | — | — | |
| LongT5_XLARGENumber of Parameters=3B2022.08 | 21.9 | — | — | — | |
| LongT5-large# Param=750M2022.09 | 21.6 | 48.3 | 44.1 | — | |
| PageSum# Param=440M2022.09 | 21.1 | 49.7 | 44.7 | — | |
| PRIMERABase Model=LED-large2023.08 | 20.8 | 47.6 | 42.6 | — | |
| Top-down (AvgP)# Param=460M2022.09 | 20.7 | 48.7 | 43.9 | — | |
| LongT5_LARGENumber of Parameters=705M2022.08 | 20.6 | — | — | — | |
| BART-Hepos# Param=440M2022.09 | 20.3 | 48.2 | 41.8 | — | |
| HEPOSBase Model=BART-large2023.08 | 20 | 47.87 | 41.5 | — | |
| SimCASBase Model=BART-large2023.08 | 19.77 | 48.14 | 42.93 | 63.78 | |
| StandardBase Model=LED-large2023.08 | 19.62 | 46.63 | 41.83 | — | |
| LED# Param=460M2022.09 | 19.6 | 46.6 | 41.8 | — | |
| SimCASBase Model=BART-base2023.08 | 19.35 | 47.22 | 42.25 | 63.51 | |
| BIGBIRDBase Model=PEGASUS-large2023.08 | 19.02 | 46.63 | 41.77 | — | |
| BigBird# Param=580M2022.09 | 19 | 46.6 | 41.8 | — | |
| DYLE# Param=525M2022.09 | 18 | 46.4 | 41.5 | — | |
| PEGASUS_LARGENumber of Parameters=470M2022.08 | 17.2 | — | — | — | |
| StandardBase Model=PEGASUS-large2023.08 | 16.95 | 44.21 | 38.83 | — | |
| StandardBase Model=BART-large2023.08 | 15.54 | 42.97 | 37.02 | 61.18 | |
| StandardBase Model=BART-base2023.08 | 13.78 | 40.36 | 36.11 | 59.44 |