Continual Learning on Order A Sequence KodCode Nemotron Science Nemotron Math
73.93Average PerformanceMoLEM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MoLEMBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 3 Math (Nemotron Math)2026.05 | 73.93 | 0 | 0 | 0.2 | |
| SFTBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 1 Code (KodCode)2026.05 | 66.4 | — | — | — | |
| MemGenBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 1 Code (KodCode)2026.05 | 65.33 | — | — | — | |
| MoLEMBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 2 Science (Nemotron Science)2026.05 | 64.47 | 0 | 0 | 0 | |
| MoLEMBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 1 Code (KodCode)2026.05 | 64.27 | — | — | — | |
| VanillaBase Model=Qwen3-4B-Instruct-2507, Training Stage=Vanilla2026.05 | 63.53 | — | — | — | |
| SFTBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 3 Math (Nemotron Math)2026.05 | 62.6 | 7.9 | -7.9 | -2.5 | |
| ExpeLBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 2 Science (Nemotron Science)2026.05 | 60.67 | 3.2 | -3.2 | 0.8 | |
| ExpeLBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 1 Code (KodCode)2026.05 | 60.6 | — | — | — | |
| ExpeLBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 3 Math (Nemotron Math)2026.05 | 60.6 | 0.8 | -0.8 | 0.9 | |
| SFTBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 2 Science (Nemotron Science)2026.05 | 57.87 | 2.2 | -2.2 | -1.6 | |
| MemGenBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 3 Math (Nemotron Math)2026.05 | 57.67 | 24.6 | -24.6 | 3.2 | |
| MemGenBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 2 Science (Nemotron Science)2026.05 | 44.27 | 66.4 | -66.4 | 1.4 |