Summarization Correlation on Newsroom (test)
0.372Pearson CorrelationMARS (default)
Evaluation Results
| Method | Links | |
|---|---|---|
| MARS (default)NLG System=TextRank2021.08 | 0.372 | |
| MoverScoreNLG System=Seq2Seq2021.08 | 0.337 | |
| MARS (default)NLG System=Seq2Seq2021.08 | 0.336 | |
| MARS (default)NLG System=Pointer-N2021.08 | 0.329 | |
| Naive (MLM)NLG System=Seq2Seq2021.08 | 0.324 | |
| MARS w/o. self-plan.NLG System=Pointer-N2021.08 | 0.314 | |
| BERTScoreNLG System=Seq2Seq2021.08 | 0.302 | |
| MARS w/o. self-plan.NLG System=TextRank2021.08 | 0.29 | |
| METEORNLG System=TextRank2021.08 | 0.288 | |
| BLEU-1NLG System=Seq2Seq2021.08 | 0.268 | |
| METEORNLG System=Pointer-N2021.08 | 0.256 | |
| MARS w/o. self-plan.NLG System=Seq2Seq2021.08 | 0.245 | |
| METEORNLG System=Seq2Seq2021.08 | 0.235 | |
| BLEU-1NLG System=TextRank2021.08 | 0.224 | |
| MoverScoreNLG System=Pointer-N2021.08 | 0.212 | |
| Naive (MLM)NLG System=TextRank2021.08 | 0.201 | |
| BERTScoreNLG System=Pointer-N2021.08 | 0.181 | |
| Sentence Mover's SimilarityNLG System=Pointer-N2021.08 | 0.177 | |
| MARS w/o. contextNLG System=Seq2Seq2021.08 | 0.16 | |
| BERTScoreNLG System=TextRank2021.08 | 0.154 | |
| MARS w/o. bothNLG System=Seq2Seq2021.08 | 0.149 | |
| BLEU-1NLG System=Pointer-N2021.08 | 0.115 | |
| Naive (MLM)NLG System=Pointer-N2021.08 | 0.114 | |
| Sentence Mover's SimilarityNLG System=TextRank2021.08 | 0.112 | |
| MARS w/o. contextNLG System=TextRank2021.08 | 0.107 | |
| Sentence Mover's SimilarityNLG System=Seq2Seq2021.08 | 0.099 | |
| MoverScoreNLG System=TextRank2021.08 | 0.075 | |
| ROUGE-LNLG System=Pointer-N2021.08 | 0.065 | |
| ROUGE-LNLG System=TextRank2021.08 | 0.041 | |
| PerplexityNLG System=Seq2Seq2021.08 | 0.011 | |
| MARS w/o. contextNLG System=Pointer-N2021.08 | -0.009 | |
| PerplexityNLG System=Pointer-N2021.08 | -0.035 | |
| MARS w/o. bothNLG System=Pointer-N2021.08 | -0.057 | |
| ROUGE-LNLG System=Seq2Seq2021.08 | -0.133 | |
| MARS w/o. bothNLG System=TextRank2021.08 | -0.163 | |
| PerplexityNLG System=TextRank2021.08 | -0.385 |