Text Generation on Stage-aware Prefill 8K Prompt
24.14TPOT (ms/token)SPEED-24
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SPEED-24K=242026.05 | 24.14 | 1 | |
| Full-Attn2026.05 | 24.23 | 1 | |
| POP-24K=242026.05 | 25.34 | 0.96 | |
| SwiftKV-24K=242026.05 | 25.52 | 0.95 |
Loading the SOTA2 catalog…