Model Merging on TED Talks and XLSum 40 sequential tasks (test)
84S^(γ)K-Merge
Evaluation Results
| Method | Links | |
|---|---|---|
| K-MergeOrdering=Problem Types, K=5, Backbone=Llama-3.2-1B2025.10 | 84 | |
| K-MergeOrdering=Random, K=7, Backbone=Llama-3.2-1B2025.10 | 82 | |
| K-Merge++Ordering=Random, K=7, Backbone=Llama-3.2-1B2025.10 | 82 | |
| K-Merge++Ordering=Worst, K=7, Backbone=Llama-3.2-1B2025.10 | 82 | |
| LinearOrdering=Random, K=7, Backbone=Llama-3.2-1B2025.10 | 81 | |
| K-Merge++Ordering=Random, K=5, Backbone=Llama-3.2-1B2025.10 | 81 | |
| LinearOrdering=Problem Types, K=5, Backbone=Llama-3.2-1B2025.10 | 80 | |
| K-MergeOrdering=Random, K=5, Backbone=Llama-3.2-1B2025.10 | 80 | |
| K-Merge++Ordering=Worst, K=5, Backbone=Llama-3.2-1B2025.10 | 80 | |
| LinearOrdering=Random, K=5, Backbone=Llama-3.2-1B2025.10 | 79 | |
| K-MergeOrdering=Worst, K=7, Backbone=Llama-3.2-1B2025.10 | 78 | |
| K-MergeOrdering=Worst, K=5, Backbone=Llama-3.2-1B2025.10 | 75 | |
| LinearOrdering=Worst, K=7, Backbone=Llama-3.2-1B2025.10 | 73 | |
| K-MergeOrdering=Random, K=3, Backbone=Llama-3.2-1B2025.10 | 73 | |
| K-MergeOrdering=Worst, K=3, Backbone=Llama-3.2-1B2025.10 | 73 | |
| K-Merge++Ordering=Random, K=3, Backbone=Llama-3.2-1B2025.10 | 73 | |
| K-Merge++Ordering=Worst, K=3, Backbone=Llama-3.2-1B2025.10 | 73 | |
| TIESOrdering=Problem Types, K=5, Backbone=Llama-3.2-1B2025.10 | 72 | |
| TIESOrdering=Random, K=7, Backbone=Llama-3.2-1B2025.10 | 71 | |
| LinearOrdering=Random, K=3, Backbone=Llama-3.2-1B2025.10 | 69 | |
| LinearOrdering=Worst, K=5, Backbone=Llama-3.2-1B2025.10 | 69 | |
| TIESOrdering=Worst, K=7, Backbone=Llama-3.2-1B2025.10 | 67 | |
| TIESOrdering=Random, K=5, Backbone=Llama-3.2-1B2025.10 | 65 | |
| LinearOrdering=Worst, K=3, Backbone=Llama-3.2-1B2025.10 | 62 | |
| TIESOrdering=Worst, K=5, Backbone=Llama-3.2-1B2025.10 | 56 | |
| TIESOrdering=Worst, K=3, Backbone=Llama-3.2-1B2025.10 | 52 | |
| TIESOrdering=Random, K=3, Backbone=Llama-3.2-1B2025.10 | 51 |