Summarization on SuperSummary Things we Hide from the Light (Manual analysis)
72.7Correct %Extract-Support
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Extract-SupportBase Model=Llama-3.1-70B-Instruct, Quantization=GPTQ-INT42025.02 | 72.7 | 18.2 | 9.1 | |
| Cite-HMergeBase Model=Llama-3.1-70B-Instruct, Quantization=GPTQ-INT42025.02 | 60 | 20 | 20 | |
| Zero-shotBase Model=Llama-3.1-70B-Instruct, Quantization=GPTQ-INT42025.02 | 60 | 20 | 20 | |
| HMergeBase Model=Llama-3.1-70B-Instruct, Quantization=GPTQ-INT42025.02 | 59.1 | 27.3 | 13.6 | |
| Extract-ReplaceBase Model=Llama-3.1-70B-Instruct, Quantization=GPTQ-INT42025.02 | 48.8 | 23.3 | 27.9 |