Event Concise Summarization on 5K event clusters (held-out)
71.9ROUGE-1Qwen2.5-7B-Instruct
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-7B-InstructTraining Strategy=SFT+RL, Number of parameters=7B2026.05 | 71.9 | 59.8 | 65.8 | 88.2 | |
| DeepSeek-R1-671BProtocol=few-shot, Number of parameters=671B2026.05 | 69.5 | 57.2 | 63.8 | 80.5 | |
| Qwen2.5-3B-InstructTraining Strategy=SFT+RL, Number of parameters=3B2026.05 | 68.3 | 56.2 | 60.6 | 85.5 | |
| Qwen2.5-7B-InstructTraining Strategy=SFT, Number of parameters=7B2026.05 | 68.1 | 55.4 | 61.5 | 83.5 | |
| DeepSeek-R1-671BProtocol=zero-shot, Number of parameters=671B2026.05 | 66.8 | 53.9 | 60.2 | 76.8 | |
| Qwen2.5-3B-InstructTraining Strategy=SFT, Number of parameters=3B2026.05 | 66.3 | 53.7 | 59.8 | 78.3 |