Controllable Summarization on MACSumDial
10.79Ext ScoreLlama-3.2-Instruct
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Llama-3.2-Instruct# of Params=1B2025.09 | 10.79 | 55.68 | 9.3 | 78.3 | 79.5 | 27 | 85.4 | |
| Qwen2.5-Instruct# of Params=7B2025.09 | 9.7 | 17.82 | 6.99 | 79.7 | 79.5 | 30.1 | 86.7 | |
| PACOBackbone=Llama-3.2-Instruct, # of Params=1B2025.09 | 9.3 | 17.96 | 7.22 | 79.2 | 79.4 | 28.8 | 85.9 | |
| PACOBackbone=Qwen2.5-Instruct, # of Params=7B2025.09 | 8.72 | 11.79 | 5.43 | 79.9 | 79.4 | 30.2 | 86.8 | |
| Explicit self-planningBackbone=Llama-3.3-Instruct, # of Params=70B2025.09 | 7.44 | 28.19 | 7.32 | 80.8 | 79.4 | 28.7 | 86.9 | |
| Implicit self-planningBackbone=Llama-3.3-Instruct, # of Params=70B2025.09 | 7.35 | 27.7 | 8.09 | 80.2 | 79.5 | 30.4 | 86.9 | |
| Explicit self-planning+Backbone=Llama-3.3-Instruct, # of Params=70B, variant=adaptive2025.09 | 7.08 | 24.52 | 7.32 | 80.1 | 79.5 | 31.2 | 86.9 | |
| HP+SP (BARTlarge)# of Params=406M, trained_on_data=true2025.09 | 6.66 | 34.66 | 7.08 | 80.7 | 80.4 | 31.5 | 87.1 | |
| Llama-3.3-Instruct# of Params=70B2025.09 | 6.43 | 15.72 | 7.11 | 80 | 79.8 | 32.8 | 87.1 | |
| Random sequentialBackbone=Llama-3.3-Instruct, # of Params=70B2025.09 | 5.44 | 11.16 | 4.24 | 79.7 | 79.7 | 32.2 | 86.9 | |
| Joint-iterativeBackbone=Llama-3.3-Instruct, # of Params=70B2025.09 | 5.19 | 11.19 | 5.18 | 79.7 | 79.7 | 31.9 | 86.7 | |
| PACOBackbone=Llama-3.3-Instruct, # of Params=70B2025.09 | 4.91 | 7.63 | 3.81 | 79.5 | 79.8 | 32.8 | 86.9 | |
| Reference summary# of Params=-2025.09 | 0 | 0 | 0 | 79.6 | 80.2 | — | — |