Text Generation on Stage-aware Prefill 2K Prompt
24.11TPOT (ms/token)SPEED-24
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SPEED-24K=242026.05 | 24.11 | 1 | |
| Full-Attn2026.05 | 24.22 | 1 | |
| POP-24K=242026.05 | 24.24 | 1 | |
| SwiftKV-24K=242026.05 | 25.83 | 0.94 |
Loading the SOTA2 catalog…
| Method | Links | ||
|---|---|---|---|
| SPEED-24K=242026.05 | 24.11 | 1 | |
| Full-Attn2026.05 | 24.22 | 1 | |
| POP-24K=242026.05 | 24.24 | 1 | |
| SwiftKV-24K=242026.05 | 25.83 | 0.94 |