Efficiency Analysis on Context Length 4K
60Theoretical Compute (TFLOPs)Forward Pass Only
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Forward Pass Only2026.03 | 60 | 13 | 113 | — | 130 | — | |
| LOOKAHEADKV2026.03 | 60 | 13 | 114 | 0.92 | 141 | 11.38 | |
| SnapKV2026.03 | 60 | 13 | 113 | 0.01 | 143 | 13.14 | |
| LAQ2026.03 | 61 | 444 | 347 | 233.81 | 637 | 506.58 | |
| SpecKV2026.03 | 70 | 77 | 165 | 52.1 | 223 | 92.42 |