Summarization on arXiv original (test)
60R-1Oracle
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| OracleModel Category=Oracle2022.11 | 60 | 30.6 | 53.03 | |
| GoSumModel Category=Extractive2022.11 | 48.61 | 20.53 | 42.8 | |
| MemSumModel Category=Extractive2022.11 | 48.42 | 20.3 | 42.54 | |
| Hepos-LSHModel Category=Abstractive, Attention=LSH2022.11 | 48.24 | 20.26 | 41.78 | |
| Hepos-SinkhornModel Category=Abstractive, Attention=Sinkhorn2022.11 | 47.87 | 20 | 41.5 | |
| HEROSModel Category=Extractive2022.11 | 47.74 | 20.46 | 42.39 | |
| HATModel Category=Abstractive2022.11 | 46.68 | 19.07 | 42.17 | |
| BigBird-largeModel Category=Abstractive, Scale=large2022.11 | 46.63 | 19.02 | 41.17 | |
| Topic-GraphSumModel Category=Extractive2022.11 | 46.05 | 19.97 | 33.61 | |
| HEROSModel Category=Extractive, Content Ranking=false2022.11 | 45.9 | 18.33 | 40.78 | |
| DancerModel Category=Abstractive2022.11 | 45.01 | 17.6 | 40.56 | |
| PEGASUSModel Category=Abstractive2022.11 | 44.21 | 16.95 | 38.83 | |
| Local-Global+RdLossModel Category=Extractive2022.11 | 44.01 | 17.79 | 39.09 | |
| Local-GlobalModel Category=Extractive2022.11 | 43.77 | 17.5 | 38.71 | |
| Sent-PTRModel Category=Extractive2022.11 | 42.32 | 15.63 | 38.06 | |
| BigBird-baseModel Category=Abstractive, Scale=base2022.11 | 41.22 | 16.43 | 36.96 | |
| Sent-CLFModel Category=Extractive2022.11 | 34.01 | 8.71 | 30.41 | |
| Lead-10Model Category=Extractive2022.11 | 30.52 | 10.33 | 31.44 |