Stage-aware Prefill on TULU-3 (dev) benchmark leaderboard · SOTA2 Research

Stage-aware Prefill on TULU-3 (dev)

13.13Total FLOPs (teraFLOPs)SPEED-24

Evaluation Results

Method	Links
SPEED-242026.05		13.13	22
SwiftKV-242026.05		13.18	21.7
POP-242026.05		13.257	21.2
Full-Attn2026.05		16.828	0
SPEED-242026.05		25.166	23.4
SwiftKV-242026.05		25.284	23
POP-242026.05		25.43	22.6
Full-Attn2026.05		32.853	0
SPEED-242026.05		51.731	24.2
SwiftKV-242026.05		51.986	23.8
POP-242026.05		52.269	23.4
Full-Attn2026.05		68.228	0
SPEED-242026.05		114.834	24.6
SwiftKV-242026.05		115.363	24.2
POP-242026.05		115.921	23.9
Full-Attn2026.05		152.274	0
SPEED-242026.05		280.932	24.8
SwiftKV-242026.05		282.008	24.5
POP-242026.05		283.116	24.2
Full-Attn2026.05		373.554	0
SPEED-242026.05		772.694	24.9
SwiftKV-242026.05		774.866	24.7
POP-242026.05		777.073	24.5
Full-Attn2026.05		1,028.87	0
SPEED-242026.05		2,394.485	25
SwiftKV-242026.05		2,398.847	24.8
POP-242026.05		2,403.253	24.7
Full-Attn2026.05		3,190.525	0
SPEED-242026.05		8,191.133	25
SwiftKV-242026.05		8,199.875	24.9
POP-242026.05		8,208.68	24.8
Full-Attn2026.05		10,917.923	0