Generalization on Gen
35.7Gen ScoreModular Gradient Surgery
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Modular Gradient SurgeryBackbone=Qwen-2.5-7B, Training Strategy=MIXED Training2026.02 | 35.7 | 45 | |
| Math-Chat-IFBackbone=Qwen-2.5-7B, Training Strategy=SEQUENTIAL Training2026.02 | 35.3 | 20.2 | |
| Global SurgeryBackbone=Qwen-2.5-7B, Training Strategy=MIXED Training2026.02 | 34.9 | 43 | |
| Modular Gradient SurgeryBackbone=Llama-3.1-8B, Training Strategy=MIXED Training2026.02 | 33.1 | 32.6 | |
| Normal MixingBackbone=Qwen-2.5-7B, Training Strategy=MIXED Training2026.02 | 32.8 | 44.6 | |
| Chat-Math-IFBackbone=Qwen-2.5-7B, Training Strategy=SEQUENTIAL Training2026.02 | 30.4 | 40.3 | |
| Global SurgeryBackbone=Llama-3.1-8B, Training Strategy=MIXED Training2026.02 | 30.3 | 30.3 | |
| Normal MixingBackbone=Llama-3.1-8B, Training Strategy=MIXED Training2026.02 | 25.2 | 27.3 |