List your company
ResearchFormerly WizWand

Multi-Document Summarization on Multi-News 256 (test)

46ROUGE-1PRIMERA (reported)
31.4435.223942.78Aug 1, 2022
Updated 8mo ago

Evaluation results

MethodLinks
PRIMERA (reported)Evaluation Setting=100-shot, Maximum Length=2562022.084616.822.9
CentrumEvaluation Setting=100-shot, Maximum Length=2562022.0845.716.823.2
PRIMERA (reproduced)Evaluation Setting=100-shot, Maximum Length=2562022.0845.216.322.7
PRIMERA (reported)Evaluation Setting=10-shot, Maximum Length=2562022.084415.522
CentrumEvaluation Setting=Zero-shot, Maximum Length=2562022.0843.515.722.4
PRIMERA (reproduced)Evaluation Setting=10-shot, Maximum Length=2562022.0843.415.321.6
CentrumEvaluation Setting=10-shot, Maximum Length=2562022.0843.416.622.2
Pegasus (reported)Evaluation Setting=100-shot, Maximum Length=2562022.084313.521.1
PRIMERA (reported)Evaluation Setting=Zero-shot, Maximum Length=2562022.084213.620.8
PRIMERA (reproduced)Evaluation Setting=Zero-shot, Maximum Length=2562022.0841.613.119.9
Pegasus (reported)Evaluation Setting=10-shot, Maximum Length=2562022.083912.120.3
Pegasus (reported)Evaluation Setting=Zero-shot, Maximum Length=2562022.083210.116.7