List your company
ResearchFormerly WizWand

Mathematical Reasoning on GSM8K (Speedup Ratio, Avg Acceptance Length)

3.12Avg Acceptance Length (τ)EAGLE-3
2.96883.98945.016.0306Jun 30, 2026Jul 1, 2026Jul 2, 2026Jul 3, 2026Jul 4, 2026Jul 5, 2026Jul 6, 2026
Updated 3mo ago

Evaluation results

MethodLinks
EAGLE-3Model=Qwen3-8B, Temperature=12026.063.121.87
DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=42026.063.172.32
DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=42026.063.172.34
EAGLE-3Model=Qwen3-4B, Temperature=12026.063.221.89
EAGLE-3Model=Qwen3-8B, Temperature=02026.063.231.94
DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=42026.063.292.45
EAGLE-3Model=Qwen3-4B, Temperature=02026.063.31.99
DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=42026.063.322.29
DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=322026.063.872.83
DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=322026.064.242.92
DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=82026.064.723.48
DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=82026.064.913.6
DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=82026.065.043.76
Eagle3target_model=Qwen3-4B2026.075.14—
DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=82026.065.163.56
Eagle3target_model=Qwen3-14B2026.075.24—
Eagle3target_model=Qwen3-8B2026.075.3—
DFlashtarget_model=Qwen3-8B2026.075.33—
DFlashtarget_model=Qwen3-4B2026.075.4—
DFlashtarget_model=Qwen3-14B2026.075.41—
DFlashtarget_model=Gemma4-12B2026.075.45—
DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=322026.065.574.1
DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=162026.065.814.28
Eagle3target_model=Gemma4-12B2026.075.87—
DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=162026.065.954.36
DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=322026.065.994.47
DSparktarget_model=Gemma4-12B2026.076.05—
DSparktarget_model=Qwen3-4B2026.076.11—
DSparktarget_model=Qwen3-8B2026.076.17—
DSparktarget_model=Qwen3-14B2026.076.21—
BlockPilotModel=Qwen3-8B, Temperature=12026.066.374.69
BlockPilotModel=Qwen3-4B, Temperature=12026.066.514.77
DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=162026.066.564.89
DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=162026.066.594.55
BlockPilotModel=Qwen3-8B, Temperature=02026.066.735.02
BlockPilotModel=Qwen3-4B, Temperature=02026.066.94.76