Narrative Summarization on MENSA (test)
96.83NarrativeFactScoreNEXUSSUM
Evaluation results
| Method | Links | |
|---|---|---|
| NEXUSSUMRefinement=Last Step Refinement, 3rd round2025.05 | 96.83 | |
| NEXUSSUMRefinement=Last Step Refinement, 2nd round2025.05 | 96.16 | |
| NEXUSSUMRefinement=Last Step Refinement, 1st round2025.05 | 94.43 | |
| Hierarchically Merging (HM-SR)Refinement=Agent Refinement, 3rd round2025.05 | 93.31 | |
| NEXUSSUMRefinement=None2025.05 | 90.16 | |
| Hierarchically Merging (HM-SR)Refinement=Agent Refinement, 2nd round2025.05 | 88.94 | |
| Hierarchically Merging (HM-SR)Refinement=Agent Refinement, 1st round2025.05 | 85.94 | |
| Hierarchically Merging (HM-SR)Refinement=None2025.05 | 81.05 | |
| LongT5Refinement=None2025.05 | 73.76 | |
| TextRankRefinement=None2025.05 | 59.72 | |
| LEDRefinement=None2025.05 | 56.48 |