List your company
ResearchFormerly WizWand

Text Summarization on Text Summarization (ROUGE)

26.23ROUGE-LPrahokBARTbig
10.047614.248818.4522.6512Feb 21, 2024Jun 10, 2024Sep 29, 2024Jan 17, 2025May 8, 2025Aug 26, 2025Dec 15, 2025
Updated 8mo ago

Evaluation results

MethodLinks
PrahokBARTbig#params (million)=211, Param Multiplier=3×, FLOPs (billion)=4.532025.1226.23——
PrahokBARTbase#params (million)=62, Param Multiplier=1×, FLOPs (billion)=1.132025.1225.38——
mBART50#params (million)=611, Param Multiplier=10×, FLOPs (billion)=9.062025.1219.67——
CWRAWatermark=KGW2024.0217.3318.983.63
CWRAWatermark=SIR2024.0215.7917.382.67
CWRAWatermark=UW2024.0214.2515.882.31
ParaphraseWatermark=SIR2024.0214.1415.562.11
ParaphraseWatermark=KGW2024.0213.6915.12.49
ParaphraseWatermark=UW2024.0213.3114.721.95
No attackWatermark=KGW2024.0212.9914.242.68
Re-translationWatermark=KGW2024.0212.8914.112.43
Re-translationWatermark=UW2024.0212.6313.891.77
Re-translationWatermark=SIR2024.0212.6113.631.98
No attackWatermark=SIR2024.0212.4313.341.79
No attackWatermark=UW2024.0212.3813.651.68
Random#params (million)=62, Param Multiplier=1×, FLOPs (billion)=1.132025.1210.67——