Summarization on ENTSUM 1.0 (test)
85.22ROUGE-1Lead3ent (Summary)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Lead3ent (Summary)Method Class=Oracle Entity Information, Guidance Signal=summary, Avg. Len (Sent.)=2.53, Avg. Len (Word)=86.02022.04 | 85.22 | 80.49 | 82.21 | 91.48 | |
| Lead3ent (Salient)Method Class=Oracle Entity Information, Guidance Signal=salient, Avg. Len (Sent.)=2.73, Avg. Len (Word)=91.312022.04 | 75.67 | 69.28 | 72.39 | 85.14 | |
| Lead3entMethod Class=Extractive, Avg. Len (Sent.)=2.76, Avg. Len (Word)=92.312022.04 | 68.41 | 60.51 | 65.03 | 80.08 | |
| BERTSument-top3Method Class=Extractive, Selection Strategy=top3, Avg. Len (Sent.)=2.49, Avg. Len (Word)=81.532022.04 | 67.8 | 59.7 | 64.4 | 77.89 | |
| BERTSumentMethod Class=Extractive, Avg. Len (Sent.)=4.26, Avg. Len (Word)=128.392022.04 | 65.9 | 58.7 | 62.8 | 77.67 | |
| GSument-sentMethod Class=Abstractive, Guidance Signal=entity sentence, Avg. Len (Sent.)=3.33, Avg. Len (Word)=99.622022.04 | 61.45 | 52.04 | 58.37 | 75.87 | |
| GSument-nameMethod Class=Abstractive, Guidance Signal=entity name, Avg. Len (Sent.)=3.63, Avg. Len (Word)=111.02022.04 | 51.71 | 40.49 | 48.75 | 70.11 | |
| GSumourMethod Class=Abstractive, Avg. Len (Sent.)=3.60, Avg. Len (Word)=74.312022.04 | 40.29 | 24.87 | 37.3 | 63 | |
| Lead3ovrMethod Class=Extractive, Avg. Len (Sent.)=3.0, Avg. Len (Word)=99.382022.04 | 34.44 | 19.14 | 30.97 | 58.32 | |
| BERTSumourMethod Class=Extractive, Avg. Len (Sent.)=3.03, Avg. Len (Word)=110.02022.04 | 33.8 | 17.79 | 30.17 | 58.24 | |
| BERTSumour-top3Method Class=Extractive, Selection Strategy=top3, Avg. Len (Sent.)=2.94, Avg. Len (Word)=105.782022.04 | 33.6 | 17.6 | 29.9 | 57.99 | |
| CTRLSumMethod Class=Abstractive, Avg. Len (Sent.)=4.33, Avg. Len (Word)=110.692022.04 | 32.5 | 17.58 | 29.87 | 58.07 | |
| ConvNetMethod Class=Abstractive, Avg. Len (Sent.)=3.93, Avg. Len (Word)=102.072022.04 | 28.92 | 13.52 | 25.85 | 54.72 |