Controllable Summarization on MACSumDoc
9.04Ext ScoreHP+SP (BARTlarge)
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| HP+SP (BARTlarge)# of Params=406M2025.09 | 9.04 | 19.43 | 4.55 | 80.3 | 32.7 | 88.1 | |
| Explicit self-planning# of Params=70B, Base Model=Llama-3.3-Instruct2025.09 | 8.22 | 15.64 | 3.89 | 80.8 | 28.5 | 87.5 | |
| Explicit self-planning+# of Params=70B, Base Model=Llama-3.3-Instruct2025.09 | 8.19 | 13.86 | 3.99 | 80 | 28.6 | 87.3 | |
| Implicit self-planning# of Params=70B, Base Model=Llama-3.3-Instruct2025.09 | 8.14 | 17.05 | 4.56 | 80.3 | 29.6 | 87.5 | |
| Llama-3.3-Instruct# of Params=70B2025.09 | 8.03 | 10.91 | 3.58 | 80.2 | 30.8 | 87.8 | |
| Llama-3.2-Instruct# of Params=1B2025.09 | 7.84 | 9.67 | 4.27 | 79.2 | 33 | 87.9 | |
| PACO# of Params=1B, Base Model=Llama-3.2-Instruct2025.09 | 7.53 | 4.58 | 3.73 | 79.6 | 32.6 | 87.9 | |
| Qwen2.5-Instruct# of Params=7B2025.09 | 7.39 | 13.78 | 5.42 | 79.3 | 32.1 | 87.9 | |
| PACO# of Params=7B, Base Model=Qwen2.5-Instruct2025.09 | 6.37 | 7.03 | 4.18 | 79.7 | 31.9 | 88 | |
| Random sequential# of Params=70B, Base Model=Llama-3.3-Instruct2025.09 | 5.17 | 6.62 | 3.19 | 79.7 | 30.9 | 87.5 | |
| Joint-iterative# of Params=70B, Base Model=Llama-3.3-Instruct2025.09 | 4.58 | 7.15 | 3.35 | 79.8 | 29.8 | 87.3 | |
| PACO# of Params=70B, Base Model=Llama-3.3-Instruct2025.09 | 4.49 | 4.81 | 2.84 | 79.4 | 32.2 | 87.6 | |
| Reference summary# of Params=-2025.09 | 0 | 0 | 0 | 80.6 | — | — |