List your company
ResearchFormerly WizWand

Code Generation on RepoBench

3.57SpeedupHybrid Verified Decoding
0.69961.44482.192.9352May 31, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=Greedy Decoding2026.053.57
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=EAGLE32026.052.99
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=Greedy Decoding2026.052.54
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=SuffixDecoding2026.052.15
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=Greedy Decoding2026.052.12
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=EAGLE32026.051.56
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=SuffixDecoding2026.051.44
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=Frequency-Based Hybrid Decoding2026.051.26
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=Frequency-Based Hybrid Decoding2026.051.15
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=EAGLE32026.051.09
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=SuffixDecoding2026.051.09
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=Frequency-Based Hybrid Decoding2026.050.81