List your company
ResearchFormerly WizWand

Code Generation on MBPP (Speedup)

4.78SpeedupHybrid Verified Decoding
0.74481.79242.843.8876May 31, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=SuffixDecoding2026.054.78
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=SuffixDecoding2026.054.65
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=Greedy Decoding2026.054.49
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=Greedy Decoding2026.053.68
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=Greedy Decoding2026.052.73
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=SuffixDecoding2026.052.11
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=Frequency-Based Hybrid Decoding2026.051.54
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=EAGLE32026.051.17
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=Frequency-Based Hybrid Decoding2026.051.05
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=Frequency-Based Hybrid Decoding2026.051.01
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=EAGLE32026.050.99
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=EAGLE32026.050.9