Mathematical Reasoning on MATH 500 (NFE Reduction, TPS Speedup, Accuracy)
5.46NFE ReductionSpiffy
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SpiffyBase Model=SDAR-8B-Chat-b322025.09 | 5.46 | 4.6 | 47 | |
| Dynamic UnmaskingBase Model=SDAR-8B-Chat-b322025.09 | 4.38 | 4.11 | 47 | |
| SpiffyBase Model=LLaDA-8B-Instruct2025.09 | 4.11 | 3 | 35 | |
| SpiffyBase Model=Dream-7B-Instruct2025.09 | 3.57 | 2.57 | 42 | |
| Dynamic UnmaskingBase Model=LLaDA-8B-Instruct2025.09 | 2.52 | 2.63 | 35 | |
| Dynamic UnmaskingBase Model=Dream-7B-Instruct2025.09 | 2.17 | 2.16 | 42 | |
| BaselineBase Model=LLaDA-8B-Instruct2025.09 | 1 | 1 | 34 | |
| BaselineBase Model=Dream-7B-Instruct2025.09 | 1 | 1 | 41 | |
| BaselineBase Model=SDAR-8B-Chat-b322025.09 | 1 | 1 | 49 |