List your company
ResearchFormerly WizWand

Summarization on XSum (ROUGE-1, ROUGE-2, ROUGE-L)

27.1ROUGE-2SOTA
1.55768.188814.8221.4512Jul 14, 2021Sep 16, 2021Nov 19, 2021Jan 22, 2022Mar 27, 2022May 30, 2022Aug 2, 2022
Updated 8mo ago

Evaluation results

MethodLinks
SOTAEvaluation Protocol=Finetuning2022.0827.1——
AlexaTM 20BEvaluation Protocol=Finetuning, Model Scale=20B2022.0824.16——
PaLMEvaluation Protocol=Finetuning, Model Scale=540B2022.0821.2——
T5 XXLEvaluation Protocol=Finetuning, Model Scale=XXL2022.0821——
PaLMEvaluation Protocol=Finetuning, Model Scale=62B2022.0818.5——
PaLMEvaluation Protocol=Finetuning, Model Scale=8B2022.0816.3——
PaLMEvaluation Protocol=1-shot, Model Scale=540B2022.0812.2——
AlexaTM 20BEvaluation Protocol=1-shot, Model Scale=20B2022.0811.69——
PaLMEvaluation Protocol=1-shot, Model Scale=62B2022.0811.2——
PaLMEvaluation Protocol=1-shot, Model Scale=8B2022.087.9——
HTLMzero-shot=true, prompting strategy=manually engineered, size hints=true2021.074.1222.3414.56
HTLMzero-shot=true, prompting strategy=autoprompting, size hints=true2021.073.4117.1413.43
PEGASUSzero-shot=true2021.07319.2712.72
HTLMzero-shot=true, prompting strategy=autoprompting, size hints=false2021.072.5415.1510.91