Video Processing Latency Analysis on 100-frame video sequence
0.055Latency (s)Baseline
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BaselineBackbone=Mistral 7B, Precision=FP162026.02 | 0.055 | — | |
| H2OBackbone=Mistral 7B, Precision=FP162026.02 | 0.062 | 12.7 | |
| Sali-CacheBackbone=Mistral 7B, Precision=FP162026.02 | 0.068 | 23.6 |