List your company
ResearchFormerly WizWand

Speculative Decoding on Books

3.32SpeedupNextLat
1.31281.83392.3552.8761Nov 8, 2025
Updated 5mo ago

Evaluation results

MethodLinks
NextLatd=22025.113.324.86
NextLatd=12025.112.723.64
JTPd=22025.111.91.89
MTPd=22025.111.721.83
JTPd=12025.111.470.97
MTPd=12025.111.390.95