Abstractive Summarization on Reddit sampled (test)
14.82ROUGE ScoreSelf-Consistency (SC)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Self-Consistency (SC)Shot=0-shot, Model Category=LLM (GPT-4.1)2025.12 | 14.82 | 85.55 | |
| Extract-to-Abstract (E2A)Shot=0-shot, Model Category=LLM (GPT-4.1)2025.12 | 13.87 | 85.36 | |
| Iterative Refine (IR)Shot=0-shot, Model Category=LLM (GPT-4.1)2025.12 | 13.68 | 84.27 | |
| Cited Summarization (Cite)Shot=0-shot, Model Category=LLM (GPT-4.1)2025.12 | 13.04 | 85.11 | |
| VanillaShot=0-shot, Model Category=LLM (GPT-4.1)2025.12 | 12.82 | 84.22 | |
| o1Shot=0-shot, Model Category=Large Reasoning Models (LRM)2025.12 | 12.74 | 80.74 | |
| GPT-5Shot=0-shot, Model Category=Large Reasoning Models (LRM)2025.12 | 12.45 | 80.19 | |
| Plan-then-Write (Plan)Shot=0-shot, Model Category=LLM (GPT-4.1)2025.12 | 12.43 | 83.65 | |
| Question-Answer Guided (QAG)Shot=0-shot, Model Category=LLM (GPT-4.1)2025.12 | 11.48 | 83.44 | |
| Chain-of-Thought (CoT)Shot=0-shot, Model Category=LLM (GPT-4.1)2025.12 | 11.36 | 83.85 | |
| o3Shot=0-shot, Model Category=Large Reasoning Models (LRM)2025.12 | 11.01 | 81.03 | |
| Decomposition (Deco)Shot=0-shot, Model Category=LLM (GPT-4.1)2025.12 | 10.58 | 83.39 |