Opinion Summarization on Amazon (test)
36.57ROUGE-1 ScoreCOOP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| COOPMethod Type=Abstractive2022.03 | 36.57 | 7.23 | 21.24 | — | |
| TranSumMethod Type=Abstractive2022.03 | 34.23 | 7.24 | 20.49 | — | |
| MultimodalSumModel Category=Abstractive2021.05 | 34.19 | 7.05 | 20.81 | 87.9 | |
| PlanSumMethod Type=Abstractive2022.03 | 32.87 | 6.12 | 19.05 | — | |
| SemAEMethod Type=Extractive2022.03 | 32.03 | 5.38 | 16.47 | — | |
| CopycatModel Category=Abstractive2021.05 | 31.97 | 5.81 | 20.16 | 87.7 | |
| CopyCatMethod Type=Abstractive2022.03 | 31.97 | 5.81 | 20.16 | — | |
| SemAEMethod Type=Extractive, Redundancy Control=true2022.03 | 31.92 | 5.68 | 16.61 | — | |
| OracleBERTMethod Type=Best Review, Backbone=BERT, Accesses Reference Summaries=true2022.03 | 31.69 | 6.47 | 19.25 | — | |
| LexRankBERTMethod Type=Extractive, Backbone=BERT2022.03 | 31.47 | 5.07 | 16.81 | — | |
| QTMethod Type=Extractive2022.03 | 31.27 | 5.03 | 16.42 | — | |
| LeadModel Category=Extractive2021.05 | 30.32 | 5.85 | 15.96 | 85.8 | |
| CentroidBERTMethod Type=Best Review, Backbone=BERT, Accesses Reference Summaries=true2022.03 | 29.94 | 5.19 | 17.7 | — | |
| LexRankModel Category=Extractive2021.05 | 29.46 | 5.53 | 17.74 | 86.4 | |
| ClustroidModel Category=Extractive2021.05 | 29.27 | 4.41 | 17.78 | 86.4 | |
| MeanSumModel Category=Abstractive2021.05 | 29.2 | 4.7 | 18.15 | — | |
| MeanSumMethod Type=Abstractive2022.03 | 29.2 | 4.7 | 18.15 | — | |
| RandomModel Category=Extractive2021.05 | 28.93 | 4.58 | 16.76 | 86 | |
| LexRankTF-IDFMethod Type=Extractive, Backbone=TF-IDF2022.03 | 28.56 | 3.98 | 15.29 | — | |
| OpinosisMethod Type=Abstractive2022.03 | 28.42 | 4.57 | 15.5 | — | |
| RandomMethod Type=Best Review, Accesses Reference Summaries=true2022.03 | 27.66 | 4.72 | 16.95 | — | |
| OpinosisModel Category=Abstractive2021.05 | 24.04 | 3.69 | 14.58 | 85.2 |