List your company
ResearchFormerly WizWand

Chat Evaluation on MT-Bench (Speedup and Acceptance Length)

2.14SpeedupHyperDFlash
1.22481.46241.71.9376Jun 25, 2026
Updated 4mo ago

Evaluation results

MethodLinks
HyperDFlashTemperature=0, Drafted steps per verification round=6, Decoding mode=Think-high mode2026.062.142.79
HyperDFlashTemperature=0, Number of drafted steps=6, Mode=Non-thinking2026.062.072.72
MTPTemperature=0, Drafted steps per verification round=3, Decoding mode=Think-high mode2026.061.942.51
HyperDFlashTemperature=1, Drafted steps per verification round=6, Decoding mode=Think-high mode2026.061.932.52
MTPTemperature=0, Number of drafted steps=3, Mode=Non-thinking2026.061.912.49
HyperDFlashTemperature=1, Number of drafted steps=6, Mode=Non-thinking2026.061.912.51
MTPTemperature=1, Drafted steps per verification round=3, Decoding mode=Think-high mode2026.061.812.33
MTPTemperature=1, Number of drafted steps=3, Mode=Non-thinking2026.061.782.31
Vanilla DFlashTemperature=0, Drafted steps per verification round=6, Decoding mode=Think-high mode2026.061.431.82
MTPTemperature=0, Number of drafted steps=6, Mode=Non-thinking2026.061.392.53
Vanilla DFlashTemperature=0, Number of drafted steps=6, Mode=Non-thinking2026.061.391.76
MTPTemperature=0, Drafted steps per verification round=6, Decoding mode=Think-high mode2026.061.392.58
Vanilla DFlashTemperature=1, Drafted steps per verification round=6, Decoding mode=Think-high mode2026.061.361.73
Vanilla DFlashTemperature=1, Number of drafted steps=6, Mode=Non-thinking2026.061.331.7
MTPTemperature=1, Drafted steps per verification round=6, Decoding mode=Think-high mode2026.061.282.39
MTPTemperature=1, Number of drafted steps=6, Mode=Non-thinking2026.061.262.34