Summarization on SuperSummary (test)
22.9ROUGEExtract-S
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Extract-SModel=Llama-3.1-70B-Instruct2025.02 | 22.9 | 67.2 | 37.6 | 58.5 | 45.6 | |
| Retrieve-SModel=Llama-3.1-70B-Instruct2025.02 | 22.4 | 65.5 | 38.7 | 59.3 | 44.3 | |
| HMergeModel=Llama-3.1-70B-Instruct2025.02 | 21.8 | 65.4 | 39.1 | 57.8 | 42.2 | |
| Extract-SModel=Llama-3.1-8B-Instruct2025.02 | 21.2 | 63.7 | 38.3 | 57.2 | 39.2 | |
| Cite-HMergeModel=Llama-3.1-70B-Instruct2025.02 | 20.9 | 66.2 | 38.4 | 59.2 | 38.8 | |
| Cite-SModel=Llama-3.1-70B-Instruct2025.02 | 20.6 | 65.3 | 37.8 | 57 | 40.8 | |
| HMergeModel=Llama-3.1-8B-Instruct2025.02 | 20.3 | 63.3 | 38.7 | 55.8 | 37.8 | |
| Retrieve-SModel=Llama-3.1-8B-Instruct2025.02 | 19.9 | 65.4 | 38.6 | 56.4 | 38.4 | |
| Cite-HMergeModel=Llama-3.1-8B-Instruct2025.02 | 19.8 | 66 | 38.1 | 59.1 | 35.1 | |
| Cite-SModel=Llama-3.1-8B-Instruct2025.02 | 19.3 | 62.3 | 37.9 | 55.1 | 34.6 | |
| Zero-shotModel=Llama-3.1-70B-Instruct2025.02 | 18.9 | 58.1 | 38.4 | 57.9 | 35.2 | |
| Zero-shotModel=Llama-3.1-8B-Instruct2025.02 | 18.1 | 57.8 | 38.8 | 60.7 | 33.2 | |
| Extract-RModel=Llama-3.1-70B-Instruct2025.02 | 17.2 | 59 | 41.6 | 59.7 | 23.5 | |
| Retrieve-RModel=Llama-3.1-70B-Instruct2025.02 | 16.9 | 58.9 | 44.4 | 66.7 | 25.4 | |
| Extract-RModel=Llama-3.1-8B-Instruct2025.02 | 16.8 | 58.1 | 41.6 | 61.1 | 22.3 | |
| Retrieve-RModel=Llama-3.1-8B-Instruct2025.02 | 16.5 | 60 | 47.6 | 70.2 | 23.3 | |
| Cite-RModel=Llama-3.1-8B-Instruct2025.02 | 15.6 | 58.1 | 40.4 | 71.8 | 20.3 | |
| Cite-RModel=Llama-3.1-70B-Instruct2025.02 | 15.5 | 59.9 | 43.6 | 78.4 | 21.8 |