Autoregressive Decoding Performance on XSum (val)
1,736.88Peak VRAM (MB)PrunePath-Triton
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PrunePath-TritonBackbone=GPT-2 Medium, KV-cache=true, Implementation=Triton2026.05 | 1,736.88 | 292.59 | 12.48 | 80.15 | |
| Dense GPT-2 MediumBackbone=GPT-2 Medium, KV-cache=true2026.05 | 2,116.3 | 306.15 | 13.05 | 76.6 |