Model Merging on MMLU, TruthfulQA, BBQ, and CNN/DailyMail
69.87MMLU ScoreSA-Merging
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SA-MergingExpert Model=Qwen-14B, Adaptation Method=LoRA2026.05 | 69.87 | 55.6 | 81.35 | 18.48 | 56.33 | |
| TIES MergingExpert Model=Qwen-14B, Adaptation Method=LoRA2026.05 | 69.38 | 52.03 | 81.06 | 15.91 | 54.62 | |
| WUDI-MergingExpert Model=Qwen-14B, Adaptation Method=LoRA2026.05 | 69.17 | 55.71 | 80.56 | 17.33 | 55.69 | |
| IndividualExpert Model=Qwen-14B, Adaptation Method=LoRA2026.05 | 68.35 | 53.34 | 93.53 | 19.46 | 58.67 | |
| Task ArithmeticExpert Model=Qwen-14B, Adaptation Method=LoRA2026.05 | 67.56 | 52.33 | 78.38 | 20.54 | 54.7 |