Abstractive Summarization on WikiCatSum Film (test)
3.2CompletenessTWAG
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| TWAG2021.06 | 3.2 | 3.16 | 3.44 | — | — | |
| HierSumm2021.06 | 3.13 | 2.78 | 2.04 | — | — | |
| BART2021.06 | 2.87 | 3.02 | 3.24 | — | — | |
| CV-S2D+T2021.06 | 2.29 | 2.69 | 2.98 | — | — | |
| TF-S2S2021.06 | 1.93 | 2.71 | 2.84 | — | — | |
| BARTevaluation_scheme=QA scheme human evaluation2021.06 | — | — | — | 0.452 | 0.796 | |
| CV-S2D+Tevaluation_scheme=QA scheme human evaluation2021.06 | — | — | — | 0.04 | 0.143 | |
| HierSummevaluation_scheme=QA scheme human evaluation2021.06 | — | — | — | 0.213 | 0.327 | |
| TF-S2Sevaluation_scheme=QA scheme human evaluation2021.06 | — | — | — | 0 | 0 | |
| TWAGevaluation_scheme=QA scheme human evaluation2021.06 | — | — | — | 0.669 | 0.918 |