Summarization on QMSum (val)
0.2378ROUGE-LHiGen (end-to-end)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HiGen (end-to-end)Backbone=Llama3.1-8B2025.12 | 0.2378 | 0.5805 | 0.3839 | 0.772 | 118.53 | |
| HiGen-CCBackbone=Qwen3-8B2025.12 | 0.2338 | 0.5874 | 0.3749 | 0.7942 | 127.24 | |
| HiGen (two-step)Backbone=Qwen3-8B2025.12 | 0.2294 | 0.5871 | 0.3823 | 0.8628 | 131.39 | |
| HiGen (two-step)Backbone=Llama3.1-8B2025.12 | 0.2276 | 0.5778 | 0.3651 | 0.7688 | 142.38 | |
| LexRankBackbone=Qwen3-8B2025.12 | 0.2273 | 0.5844 | 0.3797 | 0.8173 | 122.82 | |
| DirectBackbone=Qwen3-8B2025.12 | 0.2256 | 0.5843 | 0.3788 | 0.8157 | 121.53 | |
| LexRankBackbone=Llama3.1-8B2025.12 | 0.2253 | 0.5748 | 0.3711 | 0.7093 | 136.68 | |
| SumCoTBackbone=Llama3.1-8B2025.12 | 0.2249 | 0.5614 | 0.3805 | 0.8179 | 131.71 | |
| HiGen (end-to-end)Backbone=Qwen3-32B2025.12 | 0.2237 | 0.5824 | 0.3825 | 0.7621 | 119.96 | |
| HiGen (end-to-end)Backbone=Qwen3-8B2025.12 | 0.2235 | 0.5839 | 0.3939 | 0.8501 | 105.14 | |
| HiGen-CCBackbone=Llama3.1-8B2025.12 | 0.2228 | 0.573 | 0.3645 | 0.6975 | 134.15 | |
| SumCoTBackbone=Qwen3-32B2025.12 | 0.2227 | 0.5784 | 0.3744 | 0.8039 | 125.5 | |
| SumCoTBackbone=Qwen3-8B2025.12 | 0.2202 | 0.5767 | 0.3978 | 0.8479 | 108.44 | |
| DirectBackbone=Llama3.1-8B2025.12 | 0.2199 | 0.5722 | 0.3661 | 0.7162 | 139.58 | |
| LexRankBackbone=Qwen3-32B2025.12 | 0.2191 | 0.5838 | 0.3712 | 0.7962 | 130.24 | |
| DirectBackbone=Qwen3-32B2025.12 | 0.2176 | 0.5825 | 0.3701 | 0.8002 | 132.22 | |
| HiGen (two-step)Backbone=Qwen3-32B2025.12 | 0.2162 | 0.5801 | 0.3688 | 0.8336 | 144.4 |