Efficiency Analysis on Context Length 32K
928Theoretical Compute (TFLOPs)Forward Pass Only
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Forward Pass Only2026.03 | 928 | 13 | 1,754 | — | 1,760 | — | |
| SnapKV2026.03 | 928 | 13 | 1,754 | 0.01 | 1,838 | 77.67 | |
| LOOKAHEADKV2026.03 | 929 | 13 | 1,755 | 1.74 | 1,798 | 38.04 | |
| LAQ2026.03 | 930 | 451 | 1,993 | 239.26 | 2,314 | 553.68 | |
| SpecKV2026.03 | 1,115 | 106 | 2,156 | 402.8 | 2,263 | 502.87 |