List your company
ResearchFormerly WizWand

Code Generation on MBPP (Acc., TPS)

56.4AccuracyDSB Cache (greedy)
23.95232.37640.849.224Feb 5, 2026
Updated 8mo ago

Evaluation results

MethodLinks
DSB Cache (greedy)Backbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=DSB, Block=DSB (greedy)2026.0256.461.85
DSB (greedy)Backbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=None, Block=DSB (greedy)2026.025655.67
DSB (const.)Backbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=None, Block=DSB (const.)2026.0255.860.54
Confidence + NaiveBackbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=None, Block=Naive2026.0255.462.03
DSB Cache (greedy)Backbone=Dream-v0-Base-7B, Decode=Confidence, Cache=DSB, Block=DSB (greedy)2026.0255108.5
DSB Cache (const.)Backbone=Dream-v0-Base-7B, Decode=Confidence, Cache=DSB, Block=DSB (const.)2026.0254.8115.3
VanillaBackbone=Dream-v0-Instruct-7B, Decode=Vanilla, Cache=None, Block=Naive2026.0254.213.54
DSB (const.)Backbone=Dream-v0-Base-7B, Decode=Confidence, Cache=None, Block=DSB (const.)2026.025480.3
Confidence + NaiveBackbone=Dream-v0-Base-7B, Decode=Confidence, Cache=None, Block=Naive2026.0253.880.76
DSB (greedy)Backbone=Dream-v0-Base-7B, Decode=Confidence, Cache=None, Block=DSB (greedy)2026.0253.876.9
Dual NaiveBackbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=Dual, Block=Naive2026.0253.857.94
VanillaBackbone=Dream-v0-Base-7B, Decode=Vanilla, Cache=None, Block=Naive2026.025329.01
Dual NaiveBackbone=Dream-v0-Base-7B, Decode=Confidence, Cache=Dual, Block=Naive2026.0253101.1
DSB Cache (const.)Backbone=Dream-v0-Instruct-7B, Decode=Confidence, Cache=DSB, Block=DSB (const.)2026.025259.48
VanillaBackbone=LLaDA-1.5, Decode=Vanilla, Cache=None, Block=Naive2026.0239.25.32
Confidence + NaiveBackbone=LLaDA-1.5, Decode=Confidence, Cache=None, Block=Naive2026.0239.231.08
DSB Cache (greedy)Backbone=LLaDA-1.5, Decode=Confidence, Cache=DSB, Block=DSB (greedy)2026.023747.61
DSB (const.)Backbone=LLaDA-1.5, Decode=Confidence, Cache=None, Block=DSB (const.)2026.0236.630.58
DSB (greedy)Backbone=LLaDA-1.5, Decode=Confidence, Cache=None, Block=DSB (greedy)2026.0234.829.62
Dual NaiveBackbone=LLaDA-1.5, Decode=Confidence, Cache=Dual, Block=Naive2026.0234.250.61
DSB Cache (const.)Backbone=LLaDA-1.5, Decode=Confidence, Cache=DSB, Block=DSB (const.)2026.023448.04
DSB (greedy)Backbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=None, Block=DSB (greedy)2026.023153.56
DSB (const.)Backbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=None, Block=DSB (const.)2026.0230.853.35
Confidence + NaiveBackbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=None, Block=Naive2026.0229.652.72
VanillaBackbone=LLaDA-8B-Instruct, Decode=Vanilla, Cache=None, Block=Naive2026.0229.414.33
DSB Cache (const.)Backbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=DSB, Block=DSB (const.)2026.0227.882.02
DSB Cache (greedy)Backbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=DSB, Block=DSB (greedy)2026.0227.481.88
Dual NaiveBackbone=LLaDA-8B-Instruct, Decode=Confidence, Cache=Dual, Block=Naive2026.0225.276.61