Summarization on Multi-LexSum (test)
27.6ROUGEExtract-S
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Extract-SModel=Llama-3.1-70B-Instruct2025.02 | 27.6 | 64.1 | 43.2 | 79 | 49.7 | |
| HMergeModel=Llama-3.1-70B-Instruct2025.02 | 26.7 | 64.3 | 43.4 | 76.3 | 48.2 | |
| Retrieve-SModel=Llama-3.1-70B-Instruct2025.02 | 26.6 | 66.1 | 44.5 | 78.8 | 49.8 | |
| Extract-SModel=Llama-3.1-8B-Instruct2025.02 | 25.8 | 63.3 | 40.6 | 79.4 | 47.5 | |
| Cite-HMergeModel=Llama-3.1-70B-Instruct2025.02 | 25.6 | 64 | 43.1 | 82.7 | 47.3 | |
| Cite-SModel=Llama-3.1-70B-Instruct2025.02 | 25.4 | 62.5 | 44.4 | 83.9 | 46.8 | |
| Retrieve-SModel=Llama-3.1-8B-Instruct2025.02 | 24.9 | 62.6 | 41.2 | 79.4 | 46.1 | |
| Extract-RModel=Llama-3.1-70B-Instruct2025.02 | 24.8 | 60.4 | 43.4 | 79.9 | 42.7 | |
| Retrieve-RModel=Llama-3.1-70B-Instruct2025.02 | 24.7 | 62.1 | 47.9 | 80.3 | 43.8 | |
| Zero-shotModel=Llama-3.1-8B-Instruct2025.02 | 24.6 | 60.6 | 40.9 | 79.3 | 42.7 | |
| HMergeModel=Llama-3.1-8B-Instruct2025.02 | 24.4 | 61.7 | 41.1 | 72.9 | 45.5 | |
| Extract-RModel=Llama-3.1-8B-Instruct2025.02 | 24.1 | 61.6 | 43.2 | 79.4 | 41.9 | |
| Zero-shotModel=Llama-3.1-70B-Instruct2025.02 | 23.6 | 60.7 | 43.5 | 77.6 | 41.5 | |
| Retrieve-RModel=Llama-3.1-8B-Instruct2025.02 | 23.4 | 61.5 | 47 | 84.6 | 41.8 | |
| Cite-HMergeModel=Llama-3.1-8B-Instruct2025.02 | 23.2 | 62.4 | 43.3 | 82 | 43 | |
| Cite-SModel=Llama-3.1-8B-Instruct2025.02 | 23 | 61.5 | 42.7 | 81 | 43 | |
| Cite-RModel=Llama-3.1-70B-Instruct2025.02 | 22.5 | 61.9 | 51.6 | 85.8 | 40.6 | |
| Cite-RModel=Llama-3.1-8B-Instruct2025.02 | 20.4 | 59.2 | 46.8 | 82.3 | 36.3 |