List your company
ResearchFormerly WizWand

Speculative Decoding on 20 Prompts across 4 Task Categories

6.55Mean Expected Tokens per Speculation StepSpecKV-acc.
2.52523.57014.6155.6599May 4, 2026
Updated 6mo ago

Evaluation results

MethodLinks
SpecKV-acc.Compression=NF42026.056.55
SpecKV-acc.Compression=Overall2026.056.39
SpecKV-acc.Compression=INT82026.056.36
SpecKV-acc.Compression=FP162026.056.26
SpecKV-fastCompression=NF42026.055.93
Fixed-bestCompression=NF42026.055.92
SpecKV-fastCompression=INT82026.055.85
Fixed-bestCompression=INT82026.055.84
SpecKV-fastCompression=Overall2026.055.82
Fixed-bestCompression=Overall2026.055.81
SpecKV-fastCompression=FP162026.055.68
Fixed-bestCompression=FP162026.055.67
Task-oracleCompression=INT82026.055.43
Task-oracleCompression=NF42026.054.09
Task-oracleCompression=Overall2026.054.07
Fixed-4Compression=NF42026.053.78
Fixed-4Compression=INT82026.053.75
Fixed-4Compression=Overall2026.053.73
Fixed-4Compression=FP162026.053.67
Task-oracleCompression=FP162026.052.68