Summary Generation on SPACE
93.62SCrefs(References)
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| (References)2023.05 | 93.62 | — | — | — | 58.9 | |
| (Oracle)2023.05 | 69.59 | 45.02 | 53.29 | 31.74 | 64.14 | |
| HERCULESabsSystem Category=Abstractive2023.05 | 60.11 | 14.76 | 27.22 | 24.58 | 92.04 | |
| HERCULESextSystem Category=Extractive2023.05 | 43.98 | 13.15 | 24.43 | 16.11 | 84.27 | |
| QTSystem Category=Extractive2023.05 | 41.15 | 10.28 | 21.5 | 17.12 | 90.78 | |
| COOPSystem Category=Abstractive2023.05 | 39.35 | 13.53 | 26.56 | 25.21 | 70.26 | |
| CopyCatSystem Category=Abstractive2023.05 | 37.29 | 12.07 | 22.89 | 24.55 | 68.74 | |
| BiMeanVAESystem Category=Abstractive2023.05 | 36.2 | 12.97 | 26.42 | 23.77 | 66.89 | |
| SemAESystem Category=Extractive2023.05 | 27.89 | 11.12 | 23.48 | 10.03 | 59.67 | |
| RandomSystem Category=Extractive2023.05 | 25.97 | 6.16 | 17.13 | 9.92 | 50.02 | |
| InstructGPTSystem Category=Abstractive2023.05 | 25.97 | 9.05 | 22.35 | 16.06 | 49.74 | |
| CentroidSystem Category=Extractive2023.05 | 25.82 | 7.68 | 17.79 | 14.17 | 53.99 | |
| LexRankSystem Category=Extractive2023.05 | 22.63 | 5.87 | 16.42 | 8.64 | 51.31 |