Aspect-based Summarization on SPACE (test)
43.46ROUGE-1SemAE
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| SemAESummary Type=Extract, Redundancy control=true, Aspect awareness=true2022.03 | 43.46 | — | — | — | — | — | — | 13.06 | 25.43 | 15.14 | |
| SemAESummary Type=Extract, Redundancy control=false, Aspect awareness=true2022.03 | 42.86 | — | — | — | — | — | — | 12.92 | 25.52 | 15.22 | |
| SemAESummary Type=Extract, Redundancy control=false, Aspect awareness=false2022.03 | 42.48 | — | — | — | — | — | — | 13.48 | 26.4 | 15.23 | |
| SemAESummary Type=Extract, Redundancy control=true, Aspect awareness=false2022.03 | 42.06 | — | — | — | — | — | — | 12.69 | 25.77 | 15.4 | |
| AceSumSummary Type=Abstract2022.03 | 40.37 | — | — | — | — | — | — | 11.51 | 23.23 | — | |
| QTSummary Type=Extract2022.03 | 38.66 | — | — | — | — | — | — | 10.22 | 21.9 | 14.26 | |
| CopycatSummary Type=Abstract2022.03 | 36.66 | — | — | — | — | — | — | 8.87 | 20.9 | 14.15 | |
| AceSumEXTSummary Type=Extract2022.03 | 35.5 | — | — | — | — | — | — | 7.82 | 20.09 | — | |
| MeanSumSummary Type=Abstract2022.03 | 34.95 | — | — | — | — | — | — | 7.49 | 19.92 | 14.52 | |
| OracleBERTSummary Type=Best Review, Access to reference summaries=true2022.03 | 33.21 | — | — | — | — | — | — | 8.33 | 18.02 | 9.67 | |
| OracleSENTISummary Type=Best Review, Access to reference summaries=true2022.03 | 32.14 | — | — | — | — | — | — | 7.52 | 17.43 | 9.29 | |
| LexRankBERTSummary Type=Extract2022.03 | 31.41 | — | — | — | — | — | — | 5.05 | 18.12 | 13.29 | |
| CentroidBERTSummary Type=Best Review, Access to reference summaries=true2022.03 | 31.33 | — | — | — | — | — | — | 5.78 | 16.54 | 9.35 | |
| SemAEinformativeness=included2022.03 | 31.24 | 26.9 | 25.33 | 23.57 | 20.04 | 23.72 | 25.29 | 10.43 | 24.14 | — | |
| LexRankSENTISummary Type=Extract2022.03 | 30.56 | — | — | — | — | — | — | 4.75 | 17.19 | 12.11 | |
| LexRankTF-IDFSummary Type=Extract2022.03 | 29.85 | — | — | — | — | — | — | 5.87 | 17.56 | 11.84 | |
| QT2022.03 | 28.95 | 26.07 | 23.63 | 17.79 | 16.45 | 25.12 | 21.61 | 8.34 | 21.77 | — | |
| OpinosisSummary Type=Abstract2022.03 | 28.76 | — | — | — | — | — | — | 4.57 | 15.96 | 11.68 | |
| SemAEinformativeness=w/o2022.03 | 27.85 | 25.05 | 23.32 | 19.03 | 18.38 | 24.08 | 23.89 | 8.61 | 22.29 | — | |
| LexRankBERT2022.03 | 27.72 | 26.01 | 23.28 | 17.56 | 14.73 | 25.1 | 18.24 | 7.54 | 20.82 | — | |
| CentroidSENTISummary Type=Best Review, Access to reference summaries=true2022.03 | 27.36 | — | — | — | — | — | — | 5.81 | 15.15 | 8.77 | |
| RandomSummary Type=Extract2022.03 | 26.24 | — | — | — | — | — | — | 3.58 | 14.72 | 11.53 | |
| CopyCat2022.03 | 24.95 | 20.05 | 20.31 | 14.53 | 17.1 | 15.9 | 17.3 | 4.82 | 17.53 | — | |
| MeanSum2022.03 | 23.24 | 20.4 | 18.41 | 13.01 | 13.25 | 19.24 | 17.81 | 3.72 | 17.02 | — | |
| AOSUMMModel Type=Extractive, Training=Out-of-domain synthetic data2021.10 | — | 26.9 | 20.3 | 17.4 | 16.4 | 22.8 | 21.6 | — | — | — | |
| BERTSUMModel Type=Generic2021.10 | — | 12.4 | 16.7 | 13 | 15.6 | 13.8 | 12.5 | — | — | — | |
| CTRLSUMModel Type=Aspect-based2021.10 | — | 20.1 | 18.6 | 17.4 | 18.9 | 23.3 | 19.7 | — | — | — | |
| QTModel Type=Aspect-based2021.10 | — | 26 | 23.6 | 17.7 | 16 | 25.1 | 21.6 | — | — | — |