Long-Context Inference on LongBench 32K~128K tokens v2 (medium)
28.8AccuracyH2O (Best)
Evaluation results
| Method | Links | |
|---|---|---|
| H2O (Best)KV Cache Budget=20%2026.02 | 28.8 | |
| CHESS (Aggressive)KV Cache Budget=1%2026.02 | 27.4 | |
| KeyDiff (Best)KV Cache Budget=8192 tokens2026.02 | 26.5 | |
| CHESS (Conservative)KV Cache Budget=73%2026.02 | 26 | |
| Quest (Best)KV Cache Budget=2048 tokens2026.02 | 25.6 | |
| CHESS (Moderate)KV Cache Budget=40%2026.02 | 24.7 | |
| FullKV InferenceKV Cache Budget=100%2026.02 | 24.2 | |
| SnapKV (Best)KV Cache Budget=4096 tokens2026.02 | 24.2 |