List your company
ResearchFormerly WizWand

Code Generation on HumanEval (MAT and Speedup)

8.53MAT ScoreGraft
1.47883.30945.146.9706May 19, 2026
Updated 5mo ago

Evaluation results

MethodLinks
GraftModel=Vicuna-13B2026.058.535.41
EAGLE3-2KModel=Vicuna-13B2026.058.424.8
ECHOModel=Vicuna-13B2026.058.355.15
DDDModel=Vicuna-13B2026.058.214.97
GraftModel=LLaMA3.1-8B2026.057.284.28
EAGLE3-2KModel=LLaMA3.1-8B2026.057.193.98
ECHOModel=LLaMA3.1-8B2026.057.124.13
GraftModel=Qwen3-8B2026.053.972.58
EAGLE3Model=Qwen3-8B2026.053.912.28
ECHOModel=Qwen3-8B2026.053.852.44
GraftModel=Qwen3-32B2026.053.112.51
EAGLE3Model=Qwen3-32B2026.052.962.14
ECHOModel=Qwen3-32B2026.052.822.36
MedusaModel=Vicuna-13B2026.052.782.21
TRModel=Vicuna-13B2026.052.732.09
TRModel=LLaMA3.1-8B2026.052.562.03
SpsModel=Vicuna-13B2026.052.531.78
SAMDModel=Vicuna-13B2026.052.512.25
TRModel=Qwen3-8B2026.052.451.97
TRModel=Qwen3-32B2026.052.431.91
GraftModel=Qwen3-235B2026.052.422.24
EAGLE3-2KModel=Qwen3-235B2026.052.391.81
TRModel=Qwen3-235B2026.052.311.85
ECHOModel=Qwen3-235B2026.052.32.13
PLDModel=Vicuna-13B2026.051.911.85
LookaheadModel=Vicuna-13B2026.051.751.64