Summarization on SummScreen TVMegaSite (test)
53.55R-1Top Down Transformer
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Top Down TransformerPooling strategy=AdaPool, Oracle usage=OracleAdaPool2022.03 | 53.55 | 15.63 | 51.29 | |
| Top Down TransformerPooling strategy=AdaPool2022.03 | 51.02 | 14.66 | 49.01 | |
| Top Down TransformerPooling strategy=AvgPool2022.03 | 49.3 | 14.35 | 47.45 | |
| Extractive OracleOracle usage=true2022.03 | 49 | 11.6 | 46.9 | |
| SUMMN2021.10 | 44.64 | 11.87 | 42.53 | |
| Longformer2022.03 | 42.9 | 11.9 | 41.6 | |
| Longformer+ATT2021.10 | 42.9 | 11.9 | 41.6 | |
| Hybrid (BART + Oracle Content Selection)Backbone=BART, Selection=Oracle Content Selection, Oracle usage=true2022.03 | 42.1 | 11.9 | 40.9 | |
| Hybrid (BART + Content Selection)Backbone=BART, Selection=Content Selection2022.03 | 38.8 | 10.2 | 36.9 | |
| NN+BM25+Neural2021.10 | 38.8 | — | 36.9 |