ResearchBenchmarksInference Throughput on AlpacaInference Throughput on AlpacaFollow3,348.18Prefill Throughput (tokens/s)BUDDY1,689.35922,120.01462,550.672,981.3254Jun 8, 2026Evaluation resultsMethodMethodLinksPrefill Throughput (tokens/s)Prefill SpeedupDecode Throughput (tokens/s)Decode SpeedupBUDDYRM Blocks=16(50%)RM Blocks=16(50%)2026.063,348.181.9164.841.64BUDDYRM Blocks=12(37.5%)RM Blocks=12(37.5%)2026.062,548.391.4551.491.3BUDDYRM Blocks=8(25%)RM Blocks=8(25%)2026.062,440.141.3946.81.19BUDDYRM Blocks=4(12.5%)RM Blocks=4(12.5%)2026.061,991.541.1440.031.01DenseRM Blocks=0(0.0%)RM Blocks=0(0.0%)2026.061,753.16139.481