Latency Evaluation on MultiNews
3.86End-to-End LatencyGMSA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GMSACompression Constraint=32x2026.02 | 3.86 | 0.52 | 3.34 | |
| COMICompression Constraint=32x2026.02 | 4.09 | 0.66 | 3.43 | |
| SnapKVCompression Constraint=32x2026.02 | 5.03 | — | — | |
| Activation BeaconCompression Constraint=32x2026.02 | 7.94 | — | — | |
| LongLLMLinguaCompression Constraint=32x2026.02 | 8.25 | 5.44 | 2.81 | |
| Original PromptCompression Constraint=32x2026.02 | 8.58 | — | — |