Summarization on Aggregate (test)
4.97ComprehensivenessIterative Refine (IR)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Iterative Refine (IR)Base Model=GPT-4.12025.12 | 4.97 | 4.53 | 4.99 | 4.83 | |
| IRModel Category=LLM (GPT-4.1)2025.12 | 4.97 | 4.53 | 4.99 | 4.83 | |
| Chain-of-Thought (CoT)Base Model=GPT-4.12025.12 | 4.95 | 4.06 | 4.98 | 4.66 | |
| Decomposition (Deco)Base Model=GPT-4.12025.12 | 4.95 | 4.07 | 4.98 | 4.66 | |
| COTModel Category=LLM (GPT-4.1)2025.12 | 4.95 | 4.06 | 4.98 | 4.66 | |
| DecoModel Category=LLM (GPT-4.1)2025.12 | 4.95 | 4.07 | 4.98 | 4.66 | |
| VanillaBase Model=GPT-4.12025.12 | 4.93 | 4.57 | 4.97 | 4.82 | |
| Self-Consistency (SC)Base Model=GPT-4.12025.12 | 4.93 | 4.69 | 4.99 | 4.87 | |
| Plan-then-Write (Plan)Base Model=GPT-4.12025.12 | 4.93 | 4.02 | 4.98 | 4.65 | |
| VanillaModel Category=LLM (GPT-4.1)2025.12 | 4.93 | 4.57 | 4.97 | 4.82 | |
| SCModel Category=LLM (GPT-4.1)2025.12 | 4.93 | 4.69 | 4.99 | 4.87 | |
| PlanModel Category=LLM (GPT-4.1)2025.12 | 4.93 | 4.02 | 4.98 | 4.65 | |
| o1Model Category=Large Reasoning Models (LRM)2025.12 | 4.85 | 4.76 | 4.95 | 4.87 | |
| o3Model Category=Large Reasoning Models (LRM)2025.12 | 4.85 | 4.72 | 4.97 | 4.84 | |
| o1Model Category=Large Reasoning Models (LRM)2025.12 | 4.85 | 4.76 | 4.95 | 4.87 | |
| o3Model Category=Large Reasoning Models (LRM)2025.12 | 4.85 | 4.72 | 4.97 | 4.84 | |
| GPT-5Model Category=Large Reasoning Models (LRM)2025.12 | 4.83 | 4.4 | 4.96 | 4.73 | |
| GPT-5Model Category=Large Reasoning Models (LRM)2025.12 | 4.83 | 4.4 | 4.96 | 4.73 | |
| Cited Summarization (Cite)Base Model=GPT-4.12025.12 | 4.81 | 4.79 | 4.98 | 4.86 | |
| CiteModel Category=LLM (GPT-4.1)2025.12 | 4.81 | 4.79 | 4.98 | 4.86 | |
| Extract-to-Abstract (E2A)Base Model=GPT-4.12025.12 | 4.68 | 4.85 | 4.99 | 4.84 | |
| E2AModel Category=LLM (GPT-4.1)2025.12 | 4.68 | 4.85 | 4.99 | 4.84 | |
| Question-Answer Guided (QAG)Base Model=GPT-4.12025.12 | 3.99 | 3.72 | 4.97 | 4.23 | |
| QA-GModel Category=LLM (GPT-4.1)2025.12 | 3.99 | 3.72 | 4.97 | 4.23 |