Summarization on MovieSum (challenging set)
33.92ROUGE-1TextRank
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| TextRankMerging Strategy=without merging2025.01 | 33.92 | 4.63 | 16.25 | 46.82 | 49.48 | 48.1 | 62.43 | |
| Agent-as-a-JudgeMerging Strategy=hierarchically merging, Iteration=3rd2025.01 | 30.22 | 8.2 | 14.44 | 58.75 | 59.39 | 59.04 | 93.22 | |
| Agent-as-a-JudgeMerging Strategy=hierarchically merging, Iteration=2nd2025.01 | 29.98 | 8.19 | 14.24 | 58.61 | 59.32 | 58.94 | 90.47 | |
| Agent-as-a-JudgeMerging Strategy=hierarchically merging, Iteration=1st2025.01 | 29.02 | 8.09 | 14.08 | 58.49 | 59.3 | 58.86 | 84.59 | |
| GPT-4o-miniMerging Strategy=hierarchically merging2025.01 | 28.07 | 8.01 | 14.12 | 58.37 | 59.36 | 58.53 | 81.3 | |
| LongT5Merging Strategy=without merging2025.01 | 22.1 | 2.29 | 11.16 | 43.86 | 44.69 | 44.18 | 79.38 | |
| LEDMerging Strategy=without merging2025.01 | 2.75 | 0.17 | 0.64 | 31.78 | 24.44 | 27.37 | 11.7 |