Code Generation on MBPP (NFE Reduction, TPS Speedup, Accuracy)
8.58NFE ReductionSpiffy
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SpiffyBase Model=LLaDA-8B-Instruct2025.09 | 8.58 | 5.23 | 36 | |
| Dynamic UnmaskingBase Model=LLaDA-8B-Instruct2025.09 | 5.73 | 5.01 | 36 | |
| SpiffyBase Model=SDAR-8B-Chat-b322025.09 | 5.29 | 4.21 | 25 | |
| SpiffyBase Model=Dream-7B-Instruct2025.09 | 4 | 2.97 | 49 | |
| Dynamic UnmaskingBase Model=SDAR-8B-Chat-b322025.09 | 3.99 | 3.45 | 24 | |
| Dynamic UnmaskingBase Model=Dream-7B-Instruct2025.09 | 2.45 | 2.63 | 50 | |
| BaselineBase Model=LLaDA-8B-Instruct2025.09 | 1 | 1 | 36 | |
| BaselineBase Model=Dream-7B-Instruct2025.09 | 1 | 1 | 49 | |
| BaselineBase Model=SDAR-8B-Chat-b322025.09 | 1 | 1 | 26 |