LoRA Merging on Qwen-1.5B-Instruct 2.5 (test)
93Score S(γ)K-Merge++
Evaluation results
| Method | Links | |
|---|---|---|
| K-Merge++LoRA storage budget K=82025.10 | 93 | |
| K-Merge++LoRA storage budget K=72025.10 | 92 | |
| K-MergeLoRA storage budget K=82025.10 | 90 | |
| K-Merge++LoRA storage budget K=62025.10 | 90 | |
| LinearLoRA storage budget K=82025.10 | 89 | |
| K-MergeLoRA storage budget K=62025.10 | 89 | |
| K-MergeLoRA storage budget K=72025.10 | 89 | |
| K-Merge++LoRA storage budget K=52025.10 | 88 | |
| K-MergeLoRA storage budget K=52025.10 | 87 | |
| LinearLoRA storage budget K=62025.10 | 85 | |
| LinearLoRA storage budget K=72025.10 | 85 | |
| K-MergeLoRA storage budget K=42025.10 | 85 | |
| K-Merge++LoRA storage budget K=42025.10 | 85 | |
| LinearLoRA storage budget K=52025.10 | 83 | |
| K-MergeLoRA storage budget K=32025.10 | 83 | |
| K-Merge++LoRA storage budget K=32025.10 | 83 | |
| LinearLoRA storage budget K=42025.10 | 80 | |
| TIESLoRA storage budget K=82025.10 | 80 | |
| K-MergeLoRA storage budget K=22025.10 | 79 | |
| K-Merge++LoRA storage budget K=22025.10 | 79 | |
| LinearLoRA storage budget K=32025.10 | 78 | |
| TIESLoRA storage budget K=72025.10 | 78 | |
| TIESLoRA storage budget K=62025.10 | 75 | |
| K-MergeLoRA storage budget K=12025.10 | 74 | |
| K-Merge++LoRA storage budget K=12025.10 | 74 | |
| LinearLoRA storage budget K=22025.10 | 71 | |
| TIESLoRA storage budget K=52025.10 | 70 | |
| TIESLoRA storage budget K=42025.10 | 68 | |
| DARELoRA storage budget K=82025.10 | 68 | |
| LinearLoRA storage budget K=12025.10 | 67 | |
| DARELoRA storage budget K=62025.10 | 66 | |
| DARELoRA storage budget K=52025.10 | 64 | |
| DARELoRA storage budget K=72025.10 | 64 | |
| TIESLoRA storage budget K=32025.10 | 63 | |
| DARELoRA storage budget K=42025.10 | 62 | |
| DARELoRA storage budget K=32025.10 | 61 | |
| DARELoRA storage budget K=12025.10 | 60 | |
| DARELoRA storage budget K=22025.10 | 60 | |
| DARE-TIESLoRA storage budget K=72025.10 | 60 | |
| DARE-TIESLoRA storage budget K=82025.10 | 60 | |
| OPCMLoRA storage budget K=82025.10 | 60 | |
| TIESLoRA storage budget K=22025.10 | 59 | |
| DARE-TIESLoRA storage budget K=52025.10 | 59 | |
| DARE-TIESLoRA storage budget K=62025.10 | 59 | |
| TIESLoRA storage budget K=12025.10 | 58 | |
| DARE-TIESLoRA storage budget K=12025.10 | 57 | |
| DARE-TIESLoRA storage budget K=32025.10 | 57 | |
| DARE-TIESLoRA storage budget K=42025.10 | 57 | |
| DARE-TIESLoRA storage budget K=22025.10 | 56 | |
| OPCMLoRA storage budget K=72025.10 | 53 | |
| OPCMLoRA storage budget K=62025.10 | 49 | |
| OPCMLoRA storage budget K=52025.10 | 45 | |
| OPCMLoRA storage budget K=42025.10 | 44 | |
| OPCMLoRA storage budget K=32025.10 | 7 | |
| OPCMLoRA storage budget K=22025.10 | 5 | |
| OPCMLoRA storage budget K=12025.10 | 0 |