Text Generation on Stage-aware Prefill 16K Prompt
23.97TPOT (ms/token)Full-Attn
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Full-Attn2026.05 | 23.97 | 1 | |
| SPEED-24K=242026.05 | 24.16 | 0.99 | |
| SwiftKV-24K=242026.05 | 25.69 | 0.93 | |
| POP-24K=242026.05 | 26.76 | 0.9 |
Loading the SOTA2 catalog…