List your company
ResearchFormerly WizWand

Model Merging on Llama-3.2-1B-Instruct Task Set

0.83Score S(gamma)K-Merge
-0.03320.19090.4150.6391Oct 15, 2025
Updated 4mo ago

Evaluation results

MethodLinks
K-MergeLoRA storage budget K=82025.100.83
LinearLoRA storage budget K=82025.100.82
K-MergeLoRA storage budget K=72025.100.82
K-Merge++LoRA storage budget K=62025.100.82
K-Merge++LoRA storage budget K=72025.100.82
K-Merge++LoRA storage budget K=82025.100.82
LinearLoRA storage budget K=72025.100.81
K-MergeLoRA storage budget K=62025.100.81
K-Merge++LoRA storage budget K=52025.100.81
LinearLoRA storage budget K=62025.100.8
K-MergeLoRA storage budget K=52025.100.8
LinearLoRA storage budget K=52025.100.79
K-MergeLoRA storage budget K=42025.100.77
K-Merge++LoRA storage budget K=42025.100.77
TIESLoRA storage budget K=82025.100.73
K-MergeLoRA storage budget K=32025.100.73
K-Merge++LoRA storage budget K=32025.100.73
LinearLoRA storage budget K=42025.100.71
TIESLoRA storage budget K=72025.100.71
LinearLoRA storage budget K=32025.100.69
K-MergeLoRA storage budget K=22025.100.69
K-Merge++LoRA storage budget K=22025.100.69
TIESLoRA storage budget K=62025.100.67
TIESLoRA storage budget K=52025.100.65
K-MergeLoRA storage budget K=12025.100.63
K-Merge++LoRA storage budget K=12025.100.63
LinearLoRA storage budget K=22025.100.62
DARELoRA storage budget K=82025.100.61
DARELoRA storage budget K=72025.100.6
DARELoRA storage budget K=42025.100.59
DARELoRA storage budget K=62025.100.59
TIESLoRA storage budget K=42025.100.58
DARELoRA storage budget K=52025.100.58
OPCMLoRA storage budget K=82025.100.58
DARELoRA storage budget K=32025.100.54
DARE-TIESLoRA storage budget K=82025.100.53
DARELoRA storage budget K=22025.100.52
DARE-TIESLoRA storage budget K=72025.100.52
OPCMLoRA storage budget K=72025.100.52
LinearLoRA storage budget K=12025.100.51
TIESLoRA storage budget K=22025.100.51
TIESLoRA storage budget K=32025.100.51
DARE-TIESLoRA storage budget K=42025.100.51
DARE-TIESLoRA storage budget K=52025.100.51
DARE-TIESLoRA storage budget K=62025.100.51
DARELoRA storage budget K=12025.100.5
OPCMLoRA storage budget K=62025.100.5
DARE-TIESLoRA storage budget K=32025.100.49
DARE-TIESLoRA storage budget K=12025.100.48
DARE-TIESLoRA storage budget K=22025.100.48
TIESLoRA storage budget K=12025.100.47
OPCMLoRA storage budget K=52025.100.44
OPCMLoRA storage budget K=32025.100.4
OPCMLoRA storage budget K=42025.100.38
OPCMLoRA storage budget K=22025.100.21
OPCMLoRA storage budget K=12025.100