Code Generation on MBPP (Acc., TPS)
56.4AccuracyDSB Cache (greedy)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DSB Cache (greedy)Backbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=DSB, Block=DSB (greedy)2026.02 | 56.4 | 61.85 | |
| DSB (greedy)Backbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=None, Block=DSB (greedy)2026.02 | 56 | 55.67 | |
| DSB (const.)Backbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=None, Block=DSB (const.)2026.02 | 55.8 | 60.54 | |
| Confidence + NaiveBackbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=None, Block=Naive2026.02 | 55.4 | 62.03 | |
| DSB Cache (greedy)Backbone=Dream-v0-Base-7B, Decode=Confidence, Cache=DSB, Block=DSB (greedy)2026.02 | 55 | 108.5 | |
| DSB Cache (const.)Backbone=Dream-v0-Base-7B, Decode=Confidence, Cache=DSB, Block=DSB (const.)2026.02 | 54.8 | 115.3 | |
| VanillaBackbone=Dream-v0-Instruct-7B, Decode=Vanilla, Cache=None, Block=Naive2026.02 | 54.2 | 13.54 | |
| DSB (const.)Backbone=Dream-v0-Base-7B, Decode=Confidence, Cache=None, Block=DSB (const.)2026.02 | 54 | 80.3 | |
| Confidence + NaiveBackbone=Dream-v0-Base-7B, Decode=Confidence, Cache=None, Block=Naive2026.02 | 53.8 | 80.76 | |
| DSB (greedy)Backbone=Dream-v0-Base-7B, Decode=Confidence, Cache=None, Block=DSB (greedy)2026.02 | 53.8 | 76.9 | |
| Dual NaiveBackbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=Dual, Block=Naive2026.02 | 53.8 | 57.94 | |
| VanillaBackbone=Dream-v0-Base-7B, Decode=Vanilla, Cache=None, Block=Naive2026.02 | 53 | 29.01 | |
| Dual NaiveBackbone=Dream-v0-Base-7B, Decode=Confidence, Cache=Dual, Block=Naive2026.02 | 53 | 101.1 | |
| DSB Cache (const.)Backbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=DSB, Block=DSB (const.)2026.02 | 52 | 59.48 | |
| VanillaBackbone=LLaDA-1.5, Decode=Vanilla, Cache=None, Block=Naive2026.02 | 39.2 | 5.32 | |
| Confidence + NaiveBackbone=LLaDA-1.5, Decode=Confidence, Cache=None, Block=Naive2026.02 | 39.2 | 31.08 | |
| DSB Cache (greedy)Backbone=LLaDA-1.5, Decode=Confidence, Cache=DSB, Block=DSB (greedy)2026.02 | 37 | 47.61 | |
| DSB (const.)Backbone=LLaDA-1.5, Decode=Confidence, Cache=None, Block=DSB (const.)2026.02 | 36.6 | 30.58 | |
| DSB (greedy)Backbone=LLaDA-1.5, Decode=Confidence, Cache=None, Block=DSB (greedy)2026.02 | 34.8 | 29.62 | |
| Dual NaiveBackbone=LLaDA-1.5, Decode=Confidence, Cache=Dual, Block=Naive2026.02 | 34.2 | 50.61 | |
| DSB Cache (const.)Backbone=LLaDA-1.5, Decode=Confidence, Cache=DSB, Block=DSB (const.)2026.02 | 34 | 48.04 | |
| DSB (greedy)Backbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=None, Block=DSB (greedy)2026.02 | 31 | 53.56 | |
| DSB (const.)Backbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=None, Block=DSB (const.)2026.02 | 30.8 | 53.35 | |
| Confidence + NaiveBackbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=None, Block=Naive2026.02 | 29.6 | 52.72 | |
| VanillaBackbone=LLaDA-8B-Instruct, Decode=Vanilla, Cache=None, Block=Naive2026.02 | 29.4 | 14.33 | |
| DSB Cache (const.)Backbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=DSB, Block=DSB (const.)2026.02 | 27.8 | 82.02 | |
| DSB Cache (greedy)Backbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=DSB, Block=DSB (greedy)2026.02 | 27.4 | 81.88 | |
| Dual NaiveBackbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=Dual, Block=Naive2026.02 | 25.2 | 76.61 |