Summarization on MediaSum (test)
36.15R-1LongT5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LongT5Model size=xl, Input length=4k, Attention mechanism=TGlobal2021.12 | 36.15 | 19.66 | 32.8 | — | |
| LongT5Model size=large, Input length=4k, Attention mechanism=TGlobal2021.12 | 35.54 | 19.04 | 32.2 | — | |
| BARTModel size=large2021.12 | 35.09 | 18.05 | 31.44 | — | |
| BaselineBackbone=BART-base2023.05 | 33.88 | — | — | — | |
| SRformerBackbone=BART-base2023.05 | 32.36 | 14.7 | 24.75 | 28.46 | |
| BaselineBackbone=T5-small2023.05 | 29.25 | — | — | — | |
| SRformerBackbone=T5-small2023.05 | 28.59 | 12.89 | 25.72 | 26.29 | |
| SegmentedBackbone=BART-base2023.05 | 28.4 | — | — | — | |
| SegmentedBackbone=T5-small2023.05 | 24.43 | — | — | — | |
| LongT5_LARGENumber of Parameters=705M2022.08 | — | 19 | — | — | |
| LongT5_XLARGENumber of Parameters=3B2022.08 | — | 19.7 | — | — | |
| Prior SOTA2022.08 | — | 19.7 | — | — | |
| Z-Code++_LARGENumber of Parameters=710M2022.08 | — | 20.2 | — | — |