Long-context language understanding on LongBench (Average Score)
43.99LongBench Avg ScoreHeadKV w/ CriticalKV
Evaluation Results
| Method | Links | |
|---|---|---|
| HeadKV w/ CriticalKVBackbone=Llama-3.1-8B, Cache budget=20%2025.02 | 43.99 | |
| AdaKV w/ CriticalKVBackbone=Llama-3.1-8B, Cache budget=20%2025.02 | 43.77 | |
| SnapKV w/ CriticalKVBackbone=Llama-3.1-8B, Cache budget=20%2025.02 | 42.99 | |
| SnapKV w/ OBCache (Joint)Backbone=Llama-3.1-8B, Cache budget=20%2025.02 | 41.52 | |
| SnapKVBackbone=Llama-3.1-8B, Cache budget=20%2025.02 | 41.29 |