Continual Learning on Sequential Three-Stage Curriculum (Coding -> Math -> Medical)
28.3Accuracy (Coding 800 Q)Muon-OGD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Muon-OGDStage=A (Coding), Backbone=LLaMA3.2-3B-instruct2026.05 | 28.3 | — | — | 28.3 | |
| Muon-OGDStage=B (Math), Backbone=LLaMA3.2-3B-instruct2026.05 | 26.4 | 56 | — | 41.2 | |
| O-LoRAStage=A (Coding), Backbone=LLaMA3.2-3B-instruct2026.05 | 25.8 | — | — | 25.8 | |
| Muon-OGDStage=C (Medical), Backbone=LLaMA3.2-3B-instruct2026.05 | 25.1 | 55.1 | 32.9 | 37.7 | |
| Sculpting Sub.Stage=A (Coding), Backbone=LLaMA3.2-3B-instruct2026.05 | 24.7 | — | — | 24.7 | |
| SeqSFTStage=A (Coding), Backbone=LLaMA3.2-3B-instruct2026.05 | 24.4 | — | — | 24.4 | |
| Sculpting Sub.Stage=B (Math), Backbone=LLaMA3.2-3B-instruct2026.05 | 23.2 | 55 | — | 39.1 | |
| O-LoRAStage=B (Math), Backbone=LLaMA3.2-3B-instruct2026.05 | 21.4 | 55 | — | 38.2 | |
| Sculpting Sub.Stage=C (Medical), Backbone=LLaMA3.2-3B-instruct2026.05 | 20.1 | 53.8 | 31.8 | 35.2 | |
| SeqSFTStage=B (Math), Backbone=LLaMA3.2-3B-instruct2026.05 | 20 | 53 | — | 36.5 | |
| O-LoRAStage=C (Medical), Backbone=LLaMA3.2-3B-instruct2026.05 | 18.2 | 52.4 | 31.8 | 34.1 | |
| SeqSFTStage=C (Medical), Backbone=LLaMA3.2-3B-instruct2026.05 | 17 | 50 | 31.8 | 32.9 |