Coding on MBPP (pass@1 and Overall Avg.)
81Overall Average ScoreGemma2-27B-it
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemma2-27B-it#Params=27B2026.05 | 81 | — | |
| SkillWeave (Delta-Come replacement)#Params=10B2026.05 | 78 | — | |
| SKillWeave (Ours)#Params=10B2026.05 | 77.8 | — | |
| SkillWeave (ASVD replacement)#Params=10B2026.05 | 76.9 | — | |
| Qwen2.5-14B#Params=14B2026.05 | 76.7 | — | |
| Twin-Merging r1024#Params=21B2026.05 | 76.5 | — | |
| Routed LoRA r1024#Params=21B2026.05 | 76.4 | — | |
| SkillWeave (Self-Rewarding replacement)#Params=10B2026.05 | 76.3 | — | |
| PCB-Merging#Params=8B2026.05 | 76.2 | — | |
| PCB-Merge+DARE#Params=8B2026.05 | 76.2 | — | |
| TALL-Mask#Params=16.7B2026.05 | 76.2 | — | |
| Ties-Merging#Params=8B2026.05 | 76.1 | — | |
| Task Arithmetic#Params=8B2026.05 | 75.9 | — | |
| Routed LoRA r512#Params=14.1B2026.05 | 75.9 | — | |
| Jointly MTL#Params=8B2026.05 | 75.8 | — | |
| EMR-Merging#Params=16.7B2026.05 | 75.7 | — | |
| Twin-Merging r512#Params=14.1B2026.05 | 75.5 | — | |
| Llama3.1-8B-Instruct#Params=8B2026.05 | 75.4 | — | |
| Sequentially MTL#Params=8B2026.05 | 75.2 | — | |
| Self-Rewarding#Params=8B2026.05 | 74.9 | — | |
| SkillWeave (PEFT replacement)#Params=10B2026.05 | 74.2 | — | |
| Self-Align#Params=8B2026.05 | 73.3 | — | |
| SkillWeave (Self-Specialize replacement)#Params=10B2026.05 | 72.3 | — | |
| Qwen1.5-72B-Chat#Params=72B2026.05 | 71.9 | — | |
| FuseChat3.0#Params=8B2026.05 | 71.8 | — | |
| Self-MoE#Params=9B2026.05 | 71.2 | — | |
| Qwen2-57BA14B-it#Params=52B2026.05 | 70.9 | — | |
| FuseLLM#Params=8B2026.05 | 70.8 | — | |
| Anchored LearningBackbone=Llama-3.2-3B-Instruct2026.05 | 52 | 66.9 | |
| Low-SFTBackbone=Llama-3.2-3B-Instruct2026.05 | 45.6 | 63.8 | |
| STMBackbone=Llama-3.2-3B-Instruct2026.05 | 41.8 | 64.3 | |
| Iter-SFTBackbone=Llama-3.2-3B-Instruct2026.05 | 39.6 | 56.4 | |
| BaseBackbone=Llama-3.2-3B-Instruct2026.05 | 39.4 | 62.7 | |
| Self-SFTBackbone=Llama-3.2-3B-Instruct2026.05 | 37.8 | 53.4 | |
| DFTBackbone=Llama-3.2-3B-Instruct2026.05 | 24.2 | 29.1 | |
| KL-SFTBackbone=Llama-3.2-3B-Instruct2026.05 | 20.7 | 24.3 | |
| SFTBackbone=Llama-3.2-3B-Instruct2026.05 | 19.1 | 1.2 | |
| GRPOBase Model=Qwen3-14B-Base2025.09 | — | 71.84 | |
| MAPRBase Model=Qwen3-14B-Base2025.09 | — | 72.97 |