Summarization on SQUAD 1.1 (Memorization)
59F1 ScoreChain of Summaries (CoS)
Evaluation results
| Method | Links | |
|---|---|---|
| Chain of Summaries (CoS)Backbone=Qwen2.5:7B2025.11 | 59 | |
| Chain of Summaries (CoS)Backbone=GPT-4o-mini2025.11 | 46 | |
| Zero-shot summaryBackbone=GPT-4o-mini2025.11 | 41 | |
| Zero-shot summaryBackbone=Qwen2.5:7B2025.11 | 36 | |
| Chain of Summaries (CoS)Backbone=Llama3.2:3B2025.11 | 34 | |
| Zero-shot summaryBackbone=Llama3.2:3B2025.11 | 23 |