Opinion Summarization on Yelp
42.72ROUGE-1Oracle
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OracleMode=comb.2021.04 | 42.72 | 10.21 | 24 | |
| BIMEANVAEAggregation=COOP, #Param=13M2021.04 | 35.37 | 7.35 | 19.94 | |
| PlanSumCategory=Weakly Supervised2021.04 | 34.79 | 7.01 | 19.74 | |
| OptimusAggregation=COOP, #Param=239M2021.04 | 33.68 | 7 | 18.95 | |
| BIMEANVAEAggregation=SimpleAvg, #Param=13M2021.04 | 32.87 | 6.93 | 19.89 | |
| OracleMode=single2021.04 | 31.73 | 4.94 | 16.95 | |
| OptimusAggregation=SimpleAvg, #Param=239M2021.04 | 31.23 | 6.48 | 18.27 | |
| Spectral-BERTCategory=Extractive2021.04 | 30.2 | 4.5 | 17.2 | |
| DenoiseSumCategory=Abstractive2021.04 | 30.14 | 4.99 | 17.65 | |
| CopyCatCategory=Abstractive2021.04 | 29.47 | 5.26 | 18.09 | |
| OpinionDigestCategory=Weakly Supervised2021.04 | 29.3 | 5.77 | 18.56 | |
| MeanSumAggregation=SimpleAvg, #Param=28M2021.04 | 28.46 | 3.66 | 15.57 | |
| QTCategory=Extractive2021.04 | 28.4 | 3.97 | 15.27 | |
| TextVAEAggregation=SimpleAvg, #Param=13M2021.04 | 25.42 | 3.11 | 15.04 | |
| LexRankCategory=Extractive2021.04 | 25.01 | 3.62 | 14.67 | |
| OpinosisCategory=Abstractive2021.04 | 24.88 | 2.78 | 14.09 |