Text Summarization on Text Summarization (ROUGE)
26.23ROUGE-LPrahokBARTbig
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PrahokBARTbig#params (million)=211, Param Multiplier=3×, FLOPs (billion)=4.532025.12 | 26.23 | — | — | |
| PrahokBARTbase#params (million)=62, Param Multiplier=1×, FLOPs (billion)=1.132025.12 | 25.38 | — | — | |
| mBART50#params (million)=611, Param Multiplier=10×, FLOPs (billion)=9.062025.12 | 19.67 | — | — | |
| CWRAWatermark=KGW2024.02 | 17.33 | 18.98 | 3.63 | |
| CWRAWatermark=SIR2024.02 | 15.79 | 17.38 | 2.67 | |
| CWRAWatermark=UW2024.02 | 14.25 | 15.88 | 2.31 | |
| ParaphraseWatermark=SIR2024.02 | 14.14 | 15.56 | 2.11 | |
| ParaphraseWatermark=KGW2024.02 | 13.69 | 15.1 | 2.49 | |
| ParaphraseWatermark=UW2024.02 | 13.31 | 14.72 | 1.95 | |
| No attackWatermark=KGW2024.02 | 12.99 | 14.24 | 2.68 | |
| Re-translationWatermark=KGW2024.02 | 12.89 | 14.11 | 2.43 | |
| Re-translationWatermark=UW2024.02 | 12.63 | 13.89 | 1.77 | |
| Re-translationWatermark=SIR2024.02 | 12.61 | 13.63 | 1.98 | |
| No attackWatermark=SIR2024.02 | 12.43 | 13.34 | 1.79 | |
| No attackWatermark=UW2024.02 | 12.38 | 13.65 | 1.68 | |
| Random#params (million)=62, Param Multiplier=1×, FLOPs (billion)=1.132025.12 | 10.67 | — | — |