Mathematical Problem Solving on MATH 500
92MATH-500 AccuracyS2: S1 → SFT(2) 60B Targeted (Reg|Lklhd–26)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| S2: S1 → SFT(2) 60B Targeted (Reg|Lklhd–26)Campaign=S2: S1 → SFT(2) 60B Targeted 8 placements, Config=Reg|Lklhd–26, @32k speedup=2.9×2026.04 | 92 | 88.3 | 82 | — | |
| S1: Distil. 69B (Reg|Lklhd–26)Campaign=S1: Distil. 69B, Config=Reg|Lklhd–26, @32k speedup=2.9×2026.04 | 90.8 | 89.6 | 82.5 | — | |
| Nemotron-3-Nano 30BConfig=Hybrid MoE, @32k speedup=4.1×2026.04 | 89.8 | 89 | 83 | — | |
| ScaleSearchModel=Qwen3-8B2026.05 | 88.1 | — | — | — | |
| NVFP4Model=Qwen3-8B2026.05 | 73.1 | — | — | — | |
| BaselineModel=Qwen3-8B2026.05 | 72.8 | — | — | — | |
| BaselineModel=DeepSeek-R1-Distill-Qwen-1.5B2026.05 | 64.6 | — | — | — | |
| ScaleSearchModel=DeepSeek-R1-Distill-Qwen-1.5B2026.05 | 62.1 | — | — | — | |
| NVFP4Model=DeepSeek-R1-Distill-Qwen-1.5B2026.05 | 51.6 | — | — | — | |
| Reflective Masking (Ours)Base Model=LLaDA2026.06 | 24.8 | — | — | 2.4 | |
| Vanilla SFTBase Model=LLaDA2026.06 | 22.4 | — | — | — | |
| LLaDA2026.06 | 19.4 | — | — | — | |
| PRISMBase model=Llama-2-7B2026.05 | 6.33 | — | — | — | |
| PRISMBase model=Llama-2-13B2026.05 | 6.25 | — | — | — | |
| LESSBase model=Llama-2-13B2026.05 | 6.17 | — | — | — | |
| VECFILTERBase model=Llama-2-13B2026.05 | 5.83 | — | — | — | |
| LESSBase model=Llama-2-7B2026.05 | 5.58 | — | — | — | |
| VECFILTERBase model=Llama-2-7B2026.05 | 5.08 | — | — | — | |
| RandomBase model=Llama-2-13B2026.05 | 5.08 | — | — | — | |
| RandomBase model=Llama-2-7B2026.05 | 4.67 | — | — | — | |
| CONCEPTINFBase model=Llama-2-13B2026.05 | 4.42 | — | — | — | |
| CONCEPTINFBase model=Llama-2-7B2026.05 | 2.75 | — | — | — |