List your company
ResearchFormerly WizWand

Summarization on SQUAD 1.1 (Generalization)

28F1 ScoreOriginal Content
6.1611.8317.523.17Nov 12, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Original ContentBackbone=GPT-4o-mini2025.1128
Chain of Summaries (CoS)Backbone=GPT-4o-mini2025.1127
Zero-shot summaryBackbone=GPT-4o-mini2025.1127
Chain of DensityBackbone=GPT-4o-mini2025.1126
PEGASUSBackbone=GPT-4o-mini2025.1126
Chain of Summaries (CoS)Backbone=Llama3.2:3B2025.1120
Original ContentBackbone=Llama3.2:3B2025.1119
Zero-shot summaryBackbone=Llama3.2:3B2025.1118
PEGASUSBackbone=Llama3.2:3B2025.1118
Chain of DensityBackbone=Llama3.2:3B2025.1117
BRIOBackbone=GPT-4o-mini2025.1116
Original ContentBackbone=Qwen2.5:7B2025.1116
Chain of Summaries (CoS)Backbone=Qwen2.5:7B2025.1116
BRIOBackbone=Llama3.2:3B2025.1114
Zero-shot summaryBackbone=Qwen2.5:7B2025.1114
Chain of DensityBackbone=Qwen2.5:7B2025.1112
PEGASUSBackbone=Qwen2.5:7B2025.1112
BRIOBackbone=Qwen2.5:7B2025.117