List your company

Overall Average Speculative Decoding Performance

6.75Average Match Rate (MAT)HedgeSpec
0.772.32253.8755.4275Oct 22, 2025

Evaluation results

MethodLinks
HedgeSpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.106.7581.69
HedgeSpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.106.1166.15
HedgeSpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.105.7940.65
Vanilla EagleTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.105.5370.66
UCBSpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.104.8161.28
EXP3SpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.104.6759.67
UCBSpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.104.4548.43
UCBSpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.104.3331.32
EXP3SpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.104.2846.14
Vanilla EagleTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.104.247.32
EXP3SpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.104.1629.77
Vanilla EagleTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.102.8721.54
LLaMA-3.1-8B-ITTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.10118.08
Qwen-3-8BTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.10114.9
Qwen-3-32BTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.1018.53