List your company
ResearchFormerly WizWand

Prefill on Stage-aware Prefill

63.29TTFT (ms)SPEED-24
-850.12245,315.411311,480.94517,646.4787May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
SPEED-24Prompt=1K, K=242026.0563.291.23
POP-24Prompt=1K, K=242026.0572.671.07
SwiftKV-24Prompt=1K, K=242026.0574.361.04
Full-AttnPrompt=1K, K=242026.0577.641
SPEED-24Prompt=2K, K=242026.0593.951.26
SwiftKV-24Prompt=2K, K=242026.05102.261.16
POP-24Prompt=2K, K=242026.05107.421.1
Full-AttnPrompt=2K, K=242026.05118.341
SPEED-24Prompt=4K, K=242026.05180.81.31
POP-24Prompt=4K, K=242026.05187.921.26
SwiftKV-24Prompt=4K, K=242026.05189.221.25
Full-AttnPrompt=4K, K=242026.05237.351
SwiftKV-24Prompt=8K, K=242026.05398.671.33
SPEED-24Prompt=8K, K=242026.05404.411.31
POP-24Prompt=8K, K=242026.05407.131.3
Full-AttnPrompt=8K, K=242026.05530.771
SwiftKV-24Prompt=16K, K=242026.05899.591.34
SPEED-24Prompt=16K, K=242026.05918.591.31
POP-24Prompt=16K, K=242026.05921.621.31
Full-AttnPrompt=16K, K=242026.051,206.271
SwiftKV-24Prompt=32K, K=242026.052,145.11.35
POP-24Prompt=32K, K=242026.052,182.871.33
SPEED-24Prompt=32K, K=242026.052,197.521.32
Full-AttnPrompt=32K, K=242026.052,896.031
SwiftKV-24Prompt=64K, K=242026.055,6901.35
POP-24Prompt=64K, K=242026.055,757.181.33
SPEED-24Prompt=64K, K=242026.055,788.211.33
Full-AttnPrompt=64K, K=242026.057,674.121
SwiftKV-24Prompt=128K, K=242026.0517,019.021.35
POP-24Prompt=128K, K=242026.0517,093.091.34
SPEED-24Prompt=128K, K=242026.0517,199.91.33
Full-AttnPrompt=128K, K=242026.0522,898.61