List your company
ResearchFormerly WizWand

Code Generation on HumanEval (Speedup, tau)

5.89SpeedupDOMINO
1.86522.91013.9554.9999May 28, 2026
Updated 5mo ago

Evaluation results

MethodLinks
DOMINOTemperature=0, Model=Qwen3-8B, Draft size=162026.055.897.39
DOMINOTemperature=0, Model=Qwen3-4B, Draft size=162026.055.667.02
DFlashTemperature=0, Model=Qwen3-4B, Draft size=162026.055.236.63
DFlashTemperature=0, Model=Qwen3-8B, Draft size=162026.055.216.52
DOMINOTemperature=1, Model=Qwen3-4B, Draft size=162026.055.026.3
DOMINOTemperature=1, Model=Qwen3-8B, Draft size=162026.054.755.98
DFlashTemperature=1, Model=Qwen3-4B, Draft size=162026.054.735.96
DFlashTemperature=1, Model=Qwen3-8B, Draft size=162026.054.345.44
DARTTemperature=0, Model=Qwen3-8B, Draft size=602026.052.522.95
EAGLE-3Temperature=0, Model=Qwen3-8B, Draft size=602026.052.53.74
DARTTemperature=0, Model=Qwen3-4B, Draft size=602026.052.482.99
DARTTemperature=1, Model=Qwen3-4B, Draft size=602026.052.482.99
DARTTemperature=1, Model=Qwen3-8B, Draft size=602026.052.452.95
EAGLE-3Temperature=0, Model=Qwen3-4B, Draft size=602026.052.363.53
EAGLE-3Temperature=1, Model=Qwen3-8B, Draft size=602026.052.323.58
EAGLE-3Temperature=0, Model=Qwen3-8B, Draft size=162026.052.173.21
EAGLE-3Temperature=0, Model=Qwen3-4B, Draft size=162026.052.093.09
EAGLE-3Temperature=1, Model=Qwen3-4B, Draft size=602026.052.093.09
EAGLE-3Temperature=1, Model=Qwen3-8B, Draft size=162026.052.053.09
EAGLE-3Temperature=1, Model=Qwen3-4B, Draft size=162026.052.023.04