List your company
ResearchFormerly WizWand

Code Generation on MBPP (TPS, Latency, Accuracy)

314.99TPSNaive TD
211.6764238.4982265.32292.1418Feb 12, 2026
Updated 8mo ago

Evaluation results

MethodLinks
Naive TDDecoding Strategy=Dynamic, Block Size=4, Steps Per Block=4, Confidence Threshold=0.9, Temperature=0.1, Model=SDAR-4B-Chat2026.02314.990.3126.4398.89.8
T3DDecoding Strategy=Dynamic, Block Size=4, Steps Per Block=4, Confidence Threshold=0.9, Temperature=0.1, Model=SDAR-4B-Chat2026.02313.180.1916.9461.6223.6
ReDiDecoding Strategy=Dynamic, Block Size=4, Steps Per Block=4, Confidence Threshold=0.9, Temperature=0.1, Model=SDAR-4B-Chat2026.02298.830.2117.1162.5710
OriginalDecoding Strategy=Dynamic, Block Size=4, Steps Per Block=4, Confidence Threshold=0.9, Temperature=0.1, Model=SDAR-4B-Chat2026.02262.660.3627.2593.6423.4
dParallelDecoding Strategy=Dynamic, Block Size=4, Steps Per Block=4, Confidence Threshold=0.9, Temperature=0.1, Model=SDAR-4B-Chat2026.02215.650.6336.03135.168.4