List your company
ResearchFormerly WizWand

Summarization Correlation on Newsroom (test)

0.372Pearson CorrelationMARS (default)
-0.41528-0.21089-0.00650.19789Aug 19, 2021
Updated 8mo ago

Evaluation results

MethodLinks
MARS (default)NLG System=TextRank2021.080.372
MoverScoreNLG System=Seq2Seq2021.080.337
MARS (default)NLG System=Seq2Seq2021.080.336
MARS (default)NLG System=Pointer-N2021.080.329
Naive (MLM)NLG System=Seq2Seq2021.080.324
MARS w/o. self-plan.NLG System=Pointer-N2021.080.314
BERTScoreNLG System=Seq2Seq2021.080.302
MARS w/o. self-plan.NLG System=TextRank2021.080.29
METEORNLG System=TextRank2021.080.288
BLEU-1NLG System=Seq2Seq2021.080.268
METEORNLG System=Pointer-N2021.080.256
MARS w/o. self-plan.NLG System=Seq2Seq2021.080.245
METEORNLG System=Seq2Seq2021.080.235
BLEU-1NLG System=TextRank2021.080.224
MoverScoreNLG System=Pointer-N2021.080.212
Naive (MLM)NLG System=TextRank2021.080.201
BERTScoreNLG System=Pointer-N2021.080.181
Sentence Mover's SimilarityNLG System=Pointer-N2021.080.177
MARS w/o. contextNLG System=Seq2Seq2021.080.16
BERTScoreNLG System=TextRank2021.080.154
MARS w/o. bothNLG System=Seq2Seq2021.080.149
BLEU-1NLG System=Pointer-N2021.080.115
Naive (MLM)NLG System=Pointer-N2021.080.114
Sentence Mover's SimilarityNLG System=TextRank2021.080.112
MARS w/o. contextNLG System=TextRank2021.080.107
Sentence Mover's SimilarityNLG System=Seq2Seq2021.080.099
MoverScoreNLG System=TextRank2021.080.075
ROUGE-LNLG System=Pointer-N2021.080.065
ROUGE-LNLG System=TextRank2021.080.041
PerplexityNLG System=Seq2Seq2021.080.011
MARS w/o. contextNLG System=Pointer-N2021.08-0.009
PerplexityNLG System=Pointer-N2021.08-0.035
MARS w/o. bothNLG System=Pointer-N2021.08-0.057
ROUGE-LNLG System=Seq2Seq2021.08-0.133
MARS w/o. bothNLG System=TextRank2021.08-0.163
PerplexityNLG System=TextRank2021.08-0.385