Code Generation on MBPP (Acc, NFE)
42.6AccuracySWD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SWDBackbone=Dream-7B, Scoring Metric=Entropy, Decoding Strategy=Stability-Weighted Decoding, lambda=52026.04 | 42.6 | 109.4 | |
| SWDBackbone=LLaDA-8B, Scoring Metric=Confidence, Decoding Strategy=Stability-Weighted Decoding, lambda=52026.04 | 34.8 | 66.8 | |
| SWDBackbone=LLaDA-8B, Scoring Metric=Margin, Decoding Strategy=Stability-Weighted Decoding, lambda=52026.04 | 34 | 65.9 | |
| BaseBackbone=Dream-7B, Scoring Metric=Entropy, Decoding Strategy=Vanilla EB Sampler2026.04 | 33.2 | 174.7 | |
| BaseBackbone=Dream-7B, Scoring Metric=Confidence, Decoding Strategy=Vanilla EB Sampler2026.04 | 29.4 | 212.4 | |
| SWDBackbone=LLaDA-8B, Scoring Metric=Entropy, Decoding Strategy=Stability-Weighted Decoding, lambda=52026.04 | 26.6 | 108 | |
| SWDBackbone=Dream-7B, Scoring Metric=Confidence, Decoding Strategy=Stability-Weighted Decoding, lambda=52026.04 | 26.2 | 86.2 | |
| BaseBackbone=LLaDA-8B, Scoring Metric=Margin, Decoding Strategy=Vanilla EB Sampler2026.04 | 26 | 108.3 | |
| BaseBackbone=LLaDA-8B, Scoring Metric=Confidence, Decoding Strategy=Vanilla EB Sampler2026.04 | 23.4 | 110.3 | |
| BaseBackbone=Dream-7B, Scoring Metric=Margin, Decoding Strategy=Vanilla EB Sampler2026.04 | 23.4 | 202.6 | |
| BaseBackbone=LLaDA-8B, Scoring Metric=Entropy, Decoding Strategy=Vanilla EB Sampler2026.04 | 18.4 | 114.1 | |
| SWDBackbone=Dream-7B, Scoring Metric=Margin, Decoding Strategy=Stability-Weighted Decoding, lambda=52026.04 | 17.6 | 69.9 |