LoRA Merging Performance on LoRA problem types English
82Score S(gamma)K-Merge
Evaluation results
| Method | Links | |
|---|---|---|
| K-MergeLoRA storage budget K=7, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 82 | |
| LinearLoRA storage budget K=7, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 81 | |
| K-MergeLoRA storage budget K=5, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 77 | |
| LinearLoRA storage budget K=5, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 77 | |
| TIESLoRA storage budget K=7, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 72 | |
| K-MergeLoRA storage budget K=3, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 71 | |
| LinearLoRA storage budget K=3, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 65 | |
| K-MergeLoRA storage budget K=1, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 62 | |
| TIESLoRA storage budget K=5, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 61 | |
| DARELoRA storage budget K=7, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 59 | |
| DARELoRA storage budget K=5, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 58 | |
| DARELoRA storage budget K=3, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 54 | |
| LinearLoRA storage budget K=1, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 53 | |
| TIESLoRA storage budget K=3, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 53 | |
| DARELoRA storage budget K=1, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 52 | |
| TIESLoRA storage budget K=1, Base Model=Llama-3.2-3B-Instruct, Seed=single seed2025.10 | 48 |