Code Reasoning on KodCode (test)
74.2Accuracy (KodCode Test)MoLEM
Evaluation Results
| Method | Links | |
|---|---|---|
| MoLEMBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 1 Code (KodCode)2026.05 | 74.2 | |
| MoLEMBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 2 Science (Nemotron Science)2026.05 | 74.2 | |
| MoLEMBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 3 Math (Nemotron Math)2026.05 | 74.2 | |
| MemGenBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 1 Code (KodCode)2026.05 | 73.2 | |
| VanillaBase Model=Qwen3-4B-Instruct-2507, Training Stage=Vanilla2026.05 | 72 | |
| SFTBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 1 Code (KodCode)2026.05 | 62 | |
| ExpeLBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 1 Code (KodCode)2026.05 | 62 | |
| ExpeLBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 3 Math (Nemotron Math)2026.05 | 60.4 | |
| SFTBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 2 Science (Nemotron Science)2026.05 | 59.8 | |
| SFTBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 3 Math (Nemotron Math)2026.05 | 59.8 | |
| ExpeLBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 2 Science (Nemotron Science)2026.05 | 58.8 | |
| MemGenBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 3 Math (Nemotron Math)2026.05 | 29.6 | |
| MemGenBase Model=Qwen3-4B-Instruct-2507, Training Stage=Stage 2 Science (Nemotron Science)2026.05 | 6.8 |