Summarization on SummScreen (test)
44.15ROUGE-1SimCAS
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SimCASBase Model=BARTlarge2023.08 | 44.15 | 13.42 | 18.5 | 62.82 | |
| SimCASBase Model=BARTbase2023.08 | 43.45 | 12.74 | 18.38 | 62.46 | |
| SLEDBase Model=BARTlarge2023.08 | 35.2 | 8.7 | 19.4 | — | |
| UnlimiformerBase model=BART-base, Training strategy=alternating training2023.05 | 34.7 | 8.5 | 19.9 | 58.5 | |
| UnlimiformerBase Model=BARTbase2023.08 | 34.7 | 8.5 | 19.9 | 58.5 | |
| UnlimiformerBase model=PRIMERA, Training strategy=alternating training2023.05 | 33.3 | 7.6 | 18.9 | 57.7 | |
| UnlimiformerBase Model=PRIMERA2023.08 | 33.3 | 7.6 | 18.9 | 57.7 | |
| Memorizing transformersBase model=PRIMERA2023.05 | 33 | 7.3 | 18.4 | 57.3 | |
| SLEDBase model=BART-base2023.05 | 32.7 | 7.9 | 19.1 | 58.4 | |
| Memorizing transformersBase model=BART-base2023.05 | 32.7 | 7.4 | 19.2 | 57.4 | |
| SLEDBase Model=BARTbase2023.08 | 32.7 | 7.9 | 19.1 | — | |
| MemorizingBase Model=BARTbase2023.08 | 32.7 | 7.4 | 19.2 | 57.4 | |
| Standard finetuningBase model=PRIMERA2023.05 | 32.3 | 7.1 | 18.3 | 57.1 | |
| PRIMERABase Model=LEDlarge2023.08 | 32.3 | 7.1 | 18.3 | 57.1 | |
| StandardBase Model=BARTlarge2023.08 | 29.89 | 5.32 | 15.71 | 54.43 | |
| StandardBase Model=BARTbase2023.08 | 29.73 | 5.23 | 15.65 | 54.3 | |
| Standard finetuningBase model=BART-base2023.05 | 29.7 | 6.2 | 17.7 | 56.3 |