Summarization on GovReport (val)
47.2ROUGE-LHiGen (two-step)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HiGen (two-step)Backbone=Qwen3-8B2025.12 | 47.2 | 64.71 | 65.73 | 91.07 | 709.32 | |
| HiGen (two-step)Backbone=Llama3.1-8B2025.12 | 47.18 | 63.08 | 65.68 | 83.38 | 566.41 | |
| LexRankBackbone=Qwen3-8B2025.12 | 46.79 | 64.61 | 59.02 | 88.65 | 649.58 | |
| HiGen-CCBackbone=Qwen3-8B2025.12 | 46.6 | 64.46 | 56.34 | 88.34 | 639.04 | |
| HiGen (two-step)Backbone=Qwen3-32B2025.12 | 46.39 | 64.14 | 60.82 | 89.98 | 619.77 | |
| LexRankBackbone=Llama3.1-8B2025.12 | 45.93 | 63.01 | 64.24 | 77.13 | 519.7 | |
| HiGen (end-to-end)Backbone=Qwen3-32B2025.12 | 45.8 | 63.78 | 50.23 | 86.41 | 570.81 | |
| DirectBackbone=Llama3.1-8B2025.12 | 45.49 | 62.08 | 53.48 | 78.8 | 532.08 | |
| LexRankBackbone=Qwen3-32B2025.12 | 45.07 | 64.73 | 56.19 | 87.67 | 533.38 | |
| SumCoTBackbone=Llama3.1-8B2025.12 | 44.58 | 61.83 | 50.53 | 86.27 | 545.61 | |
| HiGen-CCBackbone=Llama3.1-8B2025.12 | 44.12 | 61.4 | 59.77 | 76.87 | 479.18 | |
| DirectBackbone=Qwen3-32B2025.12 | 43.19 | 63.59 | 48.14 | 90.33 | 453.16 | |
| DirectBackbone=Qwen3-8B2025.12 | 43.08 | 63.35 | 47.97 | 89.99 | 491.42 | |
| HiGen (end-to-end)Backbone=Llama3.1-8B2025.12 | 39.62 | 62.14 | 59.23 | 88.45 | 382.49 | |
| HiGen (end-to-end)Backbone=Qwen3-8B2025.12 | 38.75 | 58.67 | 46.54 | 85.7 | 407.37 | |
| SumCoTBackbone=Qwen3-32B2025.12 | 36.4 | 61.9 | 43.48 | 89.96 | 326.73 | |
| SumCoTBackbone=Qwen3-8B2025.12 | 34.19 | 60.66 | 43.92 | 90.14 | 307.04 |