Summarization on Reddit (test)
18.72ROUGE ScoreExtract-to-Abstract (E2A)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Extract-to-Abstract (E2A)Backbone=GPT-4.1, Shot-setting=2-shot2025.12 | 18.72 | 85.02 | |
| Iterative Refine (IR)Backbone=GPT-4.1, Shot-setting=2-shot2025.12 | 17.56 | 85.58 | |
| Chain-of-Thought (CoT)Backbone=GPT-4.1, Shot-setting=2-shot2025.12 | 17.23 | 84.37 | |
| Self-Consistency (SC)Backbone=GPT-4.1, Shot-setting=2-shot2025.12 | 16.07 | 84.97 | |
| VanillaBackbone=GPT-4.1, Shot-setting=2-shot2025.12 | 16.05 | 82.56 | |
| o1Backbone=Large Reasoning Model, Shot-setting=2-shot2025.12 | 15.84 | 83.25 | |
| Cited Summarization (Cite)Backbone=GPT-4.1, Shot-setting=2-shot2025.12 | 14.94 | 76.96 | |
| Question-Answer Guided (QAG)Backbone=GPT-4.1, Shot-setting=2-shot2025.12 | 14.59 | 84.95 | |
| GPT-5Backbone=Large Reasoning Model, Shot-setting=2-shot2025.12 | 14.49 | 79.96 | |
| Plan-then-Write (Plan)Backbone=GPT-4.1, Shot-setting=2-shot2025.12 | 12.97 | 83.99 | |
| o3Backbone=Large Reasoning Model, Shot-setting=2-shot2025.12 | 12.55 | 74.04 | |
| Decomposition (Deco)Backbone=GPT-4.1, Shot-setting=2-shot2025.12 | 12.18 | 81.69 |