Summarization on SQUAD 1.1 (Generalization)
28F1 ScoreOriginal Content
Evaluation Results
| Method | Links | |
|---|---|---|
| Original ContentBackbone=GPT-4o-mini2025.11 | 28 | |
| Chain of Summaries (CoS)Backbone=GPT-4o-mini2025.11 | 27 | |
| Zero-shot summaryBackbone=GPT-4o-mini2025.11 | 27 | |
| Chain of DensityBackbone=GPT-4o-mini2025.11 | 26 | |
| PEGASUSBackbone=GPT-4o-mini2025.11 | 26 | |
| Chain of Summaries (CoS)Backbone=Llama3.2:3B2025.11 | 20 | |
| Original ContentBackbone=Llama3.2:3B2025.11 | 19 | |
| Zero-shot summaryBackbone=Llama3.2:3B2025.11 | 18 | |
| PEGASUSBackbone=Llama3.2:3B2025.11 | 18 | |
| Chain of DensityBackbone=Llama3.2:3B2025.11 | 17 | |
| BRIOBackbone=GPT-4o-mini2025.11 | 16 | |
| Original ContentBackbone=Qwen2.5:7B2025.11 | 16 | |
| Chain of Summaries (CoS)Backbone=Qwen2.5:7B2025.11 | 16 | |
| BRIOBackbone=Llama3.2:3B2025.11 | 14 | |
| Zero-shot summaryBackbone=Qwen2.5:7B2025.11 | 14 | |
| Chain of DensityBackbone=Qwen2.5:7B2025.11 | 12 | |
| PEGASUSBackbone=Qwen2.5:7B2025.11 | 12 | |
| BRIOBackbone=Qwen2.5:7B2025.11 | 7 |