Efficiency Analysis on Context Length 16K
336Theoretical Compute (TFLOPs)Forward Pass Only
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Forward Pass Only2026.03 | 336 | 13 | 635 | — | 658 | — | |
| SnapKV2026.03 | 336 | 13 | 635 | 0.01 | 695 | 37.12 | |
| LOOKAHEADKV2026.03 | 337 | 13 | 636 | 1.27 | 677 | 18.5 | |
| LAQ2026.03 | 337 | 447 | 871 | 236.15 | 1,182 | 523.54 | |
| SpecKV2026.03 | 398 | 89 | 792 | 157.05 | 866 | 207.31 |