Software Engineering on SWE tasks Refactor API Migration n = 39 (test)
56.12F1 ScoreParametricSkills
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ParametricSkillsBackbone=Qwen3-8B, Skill Type=Parametric (Hypernetwork generated)2026.06 | 56.12 | 88.78 | 57.31 | |
| No-SkillBackbone=Qwen3-8B, Skill Type=None2026.06 | 52.65 | 87.51 | 51.54 | |
| In-ContextBackbone=Qwen3-8B, Skill Type=In-context skills2026.06 | 50.02 | 87.7 | 46.92 | |
| SHINEBackbone=Qwen3-8B, Skill Type=Parametric (SHINE checkpoint)2026.06 | 40.45 | 87.53 | 39.1 |