List your company
ResearchFormerly WizWand

General Speculative Decoding Performance on MT-Bench, HumanEval, and GSM8K Aggregate

6.52Average Acceptance Length (τ)PPOW
1.7362.9784.225.462May 14, 2026May 16, 2026May 19, 2026May 21, 2026May 24, 2026May 26, 2026May 29, 2026
Updated 5mo ago

Evaluation results

MethodLinks
PPOWModel=Q3-8B, Temperature=0.02026.056.523.39
PPOWModel=Q3-32B, Temperature=0.02026.056.443.92
PPOWModel=L31-8B, Temperature=0.02026.056.43.46
PPOWModel=L33-70B, Temperature=0.02026.056.294.36
EAGLE-3Model=Q3-8B, Temperature=0.02026.056.163.17
EAGLE-3Model=L31-8B, Temperature=0.02026.056.093.41
PPOWModel=L33-70B, Temperature=1.02026.0564.21
EAGLE-3Model=Q3-32B, Temperature=0.02026.055.993.81
EAGLE-3Model=Qwen3.5-9B, m=15, Temperature (T)=0, Speculation Width (W)=42026.055.974.07
GRIFFINModel=L31-8B, Temperature=0.02026.055.953.31
EAGLE-3Model=L33-70B, Temperature=0.02026.055.944.15
GRIFFINModel=L33-70B, Temperature=0.02026.055.894.12
EAGLE-3Model=L33-70B, Temperature=1.02026.055.694
PPOWModel=Q3-32B, Temperature=1.02026.055.582.86
GRIFFINModel=L33-70B, Temperature=1.02026.055.523.9
PPOWModel=Q3-8B, Temperature=1.02026.055.482.72
PPOWModel=L31-8B, Temperature=1.02026.055.362.93
EAGLE-3Model=L31-8B, Temperature=1.02026.055.092.83
EAGLE-3Model=Q3-32B, Temperature=1.02026.055.092.67
EAGLE-3Model=Q3-8B, Temperature=1.02026.055.082.47
GRIFFINModel=L31-8B, Temperature=1.02026.055.062.81
EAGLE-3Model=Qwen3.5-9B, m=7, Temperature (T)=0, Speculation Width (W)=42026.055.054.14
EAGLE-3Model=Qwen3.5-4B, m=15, Temperature (T)=0, Speculation Width (W)=42026.054.93.33
EAGLE-3Model=Qwen3.5-4B, m=7, Temperature (T)=0, Speculation Width (W)=42026.054.43.61
EAGLE-3Model=Qwen3.5-9B, m=15, Temperature (T)=0, Speculation Width (W)=12026.054.232.88
EAGLE-3Model=Qwen3.5-9B, m=15, Temperature (T)=1, Speculation Width (W)=42026.053.982.71
EAGLE-3Model=Qwen3.5-9B, m=7, Temperature (T)=0, Speculation Width (W)=12026.053.863.17
SPDModel=Qwen3.5-9B, n=16, Ls=2, Temperature (T)=1, Speculation Width (W)=42026.053.833.83
EAGLE-3Model=Qwen3.5-9B, m=7, Temperature (T)=1, Speculation Width (W)=42026.053.642.99
EAGLE-3Model=Qwen3.5-4B, m=15, Temperature (T)=1, Speculation Width (W)=42026.053.582.44
EAGLE-3Model=Qwen3.5-4B, m=15, Temperature (T)=0, Speculation Width (W)=12026.053.512.39
EAGLE-3Model=Qwen3.5-9B, m=3, Temperature (T)=0, Speculation Width (W)=42026.053.463.16
SPDModel=Qwen3.5-4B, n=16, Ls=2, Temperature (T)=1, Speculation Width (W)=42026.053.443.44
SPDModel=Qwen3.5-4B, n=8, Ls=4, Temperature (T)=1, Speculation Width (W)=42026.053.433.43
EAGLE-3Model=Qwen3.5-4B, m=7, Temperature (T)=1, Speculation Width (W)=42026.053.42.79
EAGLE-3Model=Qwen3.5-4B, m=7, Temperature (T)=0, Speculation Width (W)=12026.053.322.72
SPDModel=Qwen3.5-4B, n=8, Ls=2, Temperature (T)=1, Speculation Width (W)=42026.053.283.28
SPDModel=Qwen3.5-9B, n=16, Ls=2, Temperature (T)=0, Speculation Width (W)=42026.053.243.24
SPDModel=Qwen3.5-9B, n=16, Ls=2, Temperature (T)=0, Speculation Width (W)=12026.053.213.21
SPDModel=Qwen3.5-9B, n=8, Ls=4, Temperature (T)=1, Speculation Width (W)=42026.053.153.15
SPDModel=Qwen3.5-4B, n=16, Ls=1, Temperature (T)=1, Speculation Width (W)=42026.053.133.13
EAGLE-3Model=Qwen3.5-4B, m=3, Temperature (T)=0, Speculation Width (W)=42026.053.012.75
EAGLE-3Model=Qwen3.5-9B, m=3, Temperature (T)=0, Speculation Width (W)=12026.052.942.69
SPDModel=Qwen3.5-4B, n=8, Ls=4, Temperature (T)=0, Speculation Width (W)=42026.052.912.91
EAGLE-3Model=Qwen3.5-4B, m=3, Temperature (T)=1, Speculation Width (W)=42026.052.882.63
SPDModel=Qwen3.5-4B, n=8, Ls=1, Temperature (T)=1, Speculation Width (W)=42026.052.882.88
EAGLE-3Model=Qwen3.5-9B, m=3, Temperature (T)=1, Speculation Width (W)=42026.052.882.63
SPDModel=Qwen3.5-9B, n=16, Ls=2, Temperature (T)=1, Speculation Width (W)=12026.052.872.87
EAGLE-3Model=Qwen3.5-9B, m=15, Temperature (T)=1, Speculation Width (W)=12026.052.861.95
SPDModel=Qwen3.5-4B, n=16, Ls=2, Temperature (T)=0, Speculation Width (W)=42026.052.842.84
SPDModel=Qwen3.5-4B, n=16, Ls=2, Temperature (T)=0, Speculation Width (W)=12026.052.832.83
SPDModel=Qwen3.5-4B, n=8, Ls=4, Temperature (T)=0, Speculation Width (W)=12026.052.822.82
SPDModel=Qwen3.5-9B, n=8, Ls=4, Temperature (T)=0, Speculation Width (W)=42026.052.822.82
SPDModel=Qwen3.5-4B, n=8, Ls=2, Temperature (T)=0, Speculation Width (W)=42026.052.812.81
EAGLE-3Model=Qwen3.5-9B, m=7, Temperature (T)=1, Speculation Width (W)=12026.052.752.26
SPDModel=Qwen3.5-9B, n=8, Ls=4, Temperature (T)=0, Speculation Width (W)=12026.052.742.74
SPDModel=Qwen3.5-4B, n=8, Ls=2, Temperature (T)=0, Speculation Width (W)=12026.052.722.72
EAGLE-3Model=Qwen3.5-4B, m=3, Temperature (T)=0, Speculation Width (W)=12026.052.72.47
EAGLE-3Model=Qwen3.5-4B, m=15, Temperature (T)=1, Speculation Width (W)=12026.052.651.8
SPDModel=Qwen3.5-4B, n=4, Ls=4, Temperature (T)=1, Speculation Width (W)=42026.052.652.65
SPDModel=Qwen3.5-4B, n=16, Ls=1, Temperature (T)=0, Speculation Width (W)=42026.052.642.64
SPDModel=Qwen3.5-4B, n=16, Ls=1, Temperature (T)=0, Speculation Width (W)=12026.052.622.62
SPDModel=Qwen3.5-4B, n=8, Ls=4, Temperature (T)=1, Speculation Width (W)=12026.052.562.56
SPDModel=Qwen3.5-9B, n=4, Ls=4, Temperature (T)=1, Speculation Width (W)=42026.052.552.55
SPDModel=Qwen3.5-4B, n=8, Ls=1, Temperature (T)=0, Speculation Width (W)=42026.052.532.53
EAGLE-3Model=Qwen3.5-4B, m=7, Temperature (T)=1, Speculation Width (W)=12026.052.512.06
SPDModel=Qwen3.5-4B, n=8, Ls=2, Temperature (T)=1, Speculation Width (W)=12026.052.492.49
SPDModel=Qwen3.5-9B, n=8, Ls=4, Temperature (T)=1, Speculation Width (W)=12026.052.492.49
SPDModel=Qwen3.5-4B, n=4, Ls=2, Temperature (T)=1, Speculation Width (W)=42026.052.482.48
SPDModel=Qwen3.5-4B, n=16, Ls=2, Temperature (T)=1, Speculation Width (W)=12026.052.482.48
SPDModel=Qwen3.5-4B, n=8, Ls=1, Temperature (T)=0, Speculation Width (W)=12026.052.462.46
SPDModel=Qwen3.5-4B, n=4, Ls=4, Temperature (T)=0, Speculation Width (W)=42026.052.42.4
SPDModel=Qwen3.5-9B, n=4, Ls=4, Temperature (T)=0, Speculation Width (W)=42026.052.382.38
PPSDModel=Qwen3.5-9B, n=8, Ls=1, Temperature (T)=1, Speculation Width (W)=42026.052.351.88
SPDModel=Qwen3.5-4B, n=4, Ls=1, Temperature (T)=1, Speculation Width (W)=42026.052.332.33
SPDModel=Qwen3.5-4B, n=16, Ls=1, Temperature (T)=1, Speculation Width (W)=12026.052.332.33
EAGLE-3Model=Qwen3.5-9B, m=3, Temperature (T)=1, Speculation Width (W)=12026.052.332.13
SPDModel=Qwen3.5-4B, n=4, Ls=4, Temperature (T)=0, Speculation Width (W)=12026.052.292.29
SPDModel=Qwen3.5-4B, n=4, Ls=2, Temperature (T)=0, Speculation Width (W)=42026.052.282.28
SPDModel=Qwen3.5-9B, n=4, Ls=4, Temperature (T)=0, Speculation Width (W)=12026.052.282.28
SPDModel=Qwen3.5-4B, n=8, Ls=1, Temperature (T)=1, Speculation Width (W)=12026.052.242.24
EAGLE-3Model=Qwen3.5-4B, m=3, Temperature (T)=1, Speculation Width (W)=12026.052.222.03
PPSDModel=Qwen3.5-9B, n=16, Ls=1, Temperature (T)=1, Speculation Width (W)=42026.052.21.47
SPDModel=Qwen3.5-4B, n=4, Ls=2, Temperature (T)=0, Speculation Width (W)=12026.052.192.19
SPDModel=Qwen3.5-4B, n=4, Ls=1, Temperature (T)=0, Speculation Width (W)=42026.052.172.17
PPSDModel=Qwen3.5-9B, n=8, Ls=1, Temperature (T)=0, Speculation Width (W)=12026.052.171.74
PPSDModel=Qwen3.5-9B, n=4, Ls=1, Temperature (T)=1, Speculation Width (W)=42026.052.131.89
SPDModel=Qwen3.5-4B, n=4, Ls=4, Temperature (T)=1, Speculation Width (W)=12026.052.12.1
PPSDModel=Qwen3.5-9B, n=16, Ls=1, Temperature (T)=0, Speculation Width (W)=12026.052.11.4
PPSDModel=Qwen3.5-4B, n=8, Ls=1, Temperature (T)=1, Speculation Width (W)=42026.052.091.67
SPDModel=Qwen3.5-4B, n=4, Ls=1, Temperature (T)=0, Speculation Width (W)=12026.052.082.08
PPSDModel=Qwen3.5-9B, n=8, Ls=1, Temperature (T)=0, Speculation Width (W)=42026.052.081.66
SPDModel=Qwen3.5-9B, n=4, Ls=4, Temperature (T)=1, Speculation Width (W)=12026.052.082.08
PPSDModel=Qwen3.5-9B, n=4, Ls=1, Temperature (T)=0, Speculation Width (W)=42026.052.031.8
PPSDModel=Qwen3.5-4B, n=16, Ls=1, Temperature (T)=1, Speculation Width (W)=42026.052.021.35
SPDModel=Qwen3.5-4B, n=4, Ls=2, Temperature (T)=1, Speculation Width (W)=12026.052.022.02
PPSDModel=Qwen3.5-9B, n=4, Ls=1, Temperature (T)=0, Speculation Width (W)=12026.051.981.76
PPSDModel=Qwen3.5-4B, n=8, Ls=1, Temperature (T)=0, Speculation Width (W)=12026.051.931.54
PPSDModel=Qwen3.5-4B, n=16, Ls=1, Temperature (T)=0, Speculation Width (W)=12026.051.931.29
PPSDModel=Qwen3.5-9B, n=16, Ls=1, Temperature (T)=0, Speculation Width (W)=42026.051.921.28