List your company
ResearchFormerly WizWand

Summarization on TriviaQA Generalization

80F1Chain of Summaries (CoS)
18.6434.5750.566.43Nov 12, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Chain of Summaries (CoS)Backbone=GPT-4o-mini2025.1180
Original ContentBackbone=GPT-4o-mini2025.1176
Zero-shot summaryBackbone=GPT-4o-mini2025.1173
Chain of DensityBackbone=GPT-4o-mini2025.1173
PEGASUSBackbone=GPT-4o-mini2025.1172
BRIOBackbone=GPT-4o-mini2025.1163
Chain of Summaries (CoS)Backbone=Llama3.2:3B2025.1162
Chain of Summaries (CoS)Backbone=Qwen2.5:7B2025.1160
Zero-shot summaryBackbone=Llama3.2:3B2025.1152
Original ContentBackbone=Llama3.2:3B2025.1151
PEGASUSBackbone=Llama3.2:3B2025.1150
Zero-shot summaryBackbone=Qwen2.5:7B2025.1148
Chain of DensityBackbone=Llama3.2:3B2025.1146
BRIOBackbone=Llama3.2:3B2025.1145
PEGASUSBackbone=Qwen2.5:7B2025.1143
Original ContentBackbone=Qwen2.5:7B2025.1141
Chain of DensityBackbone=Qwen2.5:7B2025.1136
BRIOBackbone=Qwen2.5:7B2025.1121