Document Summarization on QMSum (test)
38.9ROUGE-1CachED
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CachEDBackbone=BART-large, Parameters=406M2025.01 | 38.9 | 14 | 24.6 | 62.5 | |
| CachEDBackbone=BART-base, Parameters=139M2025.01 | 38.4 | 13.5 | 24.4 | 62.2 | |
| SLEDBackbone=BART-large, Parameters=406M2025.01 | 34.2 | 11 | 22 | 58.3 | |
| SLEDBackbone=BART-base, Parameters=139M2025.01 | 33.8 | 11.7 | 22.6 | 59.1 | |
| SFTBackbone=BART-large, Parameters=406M2025.01 | 33 | 7.9 | 20 | 59.5 | |
| SFTBackbone=BART-base, Parameters=139M2025.01 | 32.9 | 8.8 | 21.1 | 59.5 | |
| CachEDBackbone=T5-large, Parameters=770M2025.01 | 32.9 | 8.4 | 19.9 | 59.4 | |
| SFTBackbone=LED-base, Parameters=162M2025.01 | 30.9 | 7.8 | 19.5 | 57.6 | |
| UnlimiformerBackbone=BART-base, Parameters=139M2025.01 | 30.9 | 8 | 19.9 | 58.2 | |
| SFTBackbone=T5-large, Parameters=770M2025.01 | 29.6 | 7 | 19.4 | 57.6 |