List your company
ResearchFormerly WizWand

Stage-aware Prefill on TULU-3 (dev)

13.13Total FLOPs (teraFLOPs)SPEED-24
-423.061722,521.232395,465.52658,409.82061May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
SPEED-24Prompt length=1K, K=242026.0513.1322
SwiftKV-24Prompt length=1K, K=242026.0513.1821.7
POP-24Prompt length=1K, K=242026.0513.25721.2
Full-AttnPrompt length=1K, K=242026.0516.8280
SPEED-24Prompt length=2K, K=242026.0525.16623.4
SwiftKV-24Prompt length=2K, K=242026.0525.28423
POP-24Prompt length=2K, K=242026.0525.4322.6
Full-AttnPrompt length=2K, K=242026.0532.8530
SPEED-24Prompt length=4K, K=242026.0551.73124.2
SwiftKV-24Prompt length=4K, K=242026.0551.98623.8
POP-24Prompt length=4K, K=242026.0552.26923.4
Full-AttnPrompt length=4K, K=242026.0568.2280
SPEED-24Prompt length=8K, K=242026.05114.83424.6
SwiftKV-24Prompt length=8K, K=242026.05115.36324.2
POP-24Prompt length=8K, K=242026.05115.92123.9
Full-AttnPrompt length=8K, K=242026.05152.2740
SPEED-24Prompt length=16K, K=242026.05280.93224.8
SwiftKV-24Prompt length=16K, K=242026.05282.00824.5
POP-24Prompt length=16K, K=242026.05283.11624.2
Full-AttnPrompt length=16K, K=242026.05373.5540
SPEED-24Prompt length=32K, K=242026.05772.69424.9
SwiftKV-24Prompt length=32K, K=242026.05774.86624.7
POP-24Prompt length=32K, K=242026.05777.07324.5
Full-AttnPrompt length=32K, K=242026.051,028.870
SPEED-24Prompt length=64K, K=242026.052,394.48525
SwiftKV-24Prompt length=64K, K=242026.052,398.84724.8
POP-24Prompt length=64K, K=242026.052,403.25324.7
Full-AttnPrompt length=64K, K=242026.053,190.5250
SPEED-24Prompt length=128K, K=242026.058,191.13325
SwiftKV-24Prompt length=128K, K=242026.058,199.87524.9
POP-24Prompt length=128K, K=242026.058,208.6824.8
Full-AttnPrompt length=128K, K=242026.0510,917.9230