Text Summarization on WikiLingua (test)
0.84BertScore (EN)L8b_DTS
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| L8b_DTSMerging Technique=DARE-TIES-KnOTS, Density (d)=1, Backbone=Llama-3.1-8b-Instruct2026.01 | 0.84 | 0.833 | 0.836 | 0.836 | 0.838 | 0.836 | |
| L8b_TSMerging Technique=TIES-KnOTS, Density (d)=1, Backbone=Llama-3.1-8b-Instruct2026.01 | 0.84 | 0.833 | 0.836 | 0.836 | 0.838 | 0.836 | |
| L8b_COMBProtocol=COMB (Combined Dataset), Backbone=Llama-3.1-8b-Instruct2026.01 | 0.839 | 0.834 | 0.837 | 0.83 | 0.835 | 0.835 | |
| L8b_INDVProtocol=INDV (Language-Specific models), Backbone=Llama-3.1-8b-Instruct2026.01 | 0.837 | 0.817 | 0.835 | 0.814 | 0.836 | 0.828 | |
| L8b_TMerging Technique=TIES, Density (d)=0.5, Backbone=Llama-3.1-8b-Instruct2026.01 | 0.836 | 0.824 | 0.828 | 0.83 | 0.832 | 0.83 | |
| L8b_DTMerging Technique=DARE-TIES, Density (d)=1, Backbone=Llama-3.1-8b-Instruct2026.01 | 0.811 | 0.792 | 0.797 | 0.811 | 0.813 | 0.805 |