Model Merging for Safety and Utility on LLaMA3-8B-Instruct
12.4HS ScoreTaskArithmetic
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TaskArithmeticMerging Strategy=Task Arithmetic2026.05 | 12.4 | 70.9 | |
| Buffer-and-ReinforceMerging Strategy=QR-based merging (ours)2026.05 | 8.4 | 77.5 | |
| TIES-MergingMerging Strategy=TIES-Merging2026.05 | 7.9 | 74.8 | |
| LoRA-LEGOMerging Strategy=LoRA-LEGO2026.05 | 6.4 | 74.2 |