List your company
ResearchFormerly WizWand

Code Generation Speedup on Magicoder

5.86SpeedupHybrid Verified Decoding
0.67042.01773.3654.7123May 31, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=Greedy Decoding2026.055.86
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=SuffixDecoding2026.054.28
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=SuffixDecoding2026.053.79
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=Greedy Decoding2026.053.31
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=EAGLE32026.052.51
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=SuffixDecoding2026.051.82
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=Greedy Decoding2026.051.73
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=Frequency-Based Hybrid Decoding2026.051.34
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=Frequency-Based Hybrid Decoding2026.051.27
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=EAGLE32026.051.08
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=EAGLE32026.051.02
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=Frequency-Based Hybrid Decoding2026.050.87