Long-Context Inference on LongBench v2 (hard)
30.2AccuracyH2O (Best)
Evaluation results
| Method | Links | |
|---|---|---|
| H2O (Best)KV Cache Budget=20%2026.02 | 30.2 | |
| Quest (Best)KV Cache Budget=2048 tokens2026.02 | 30.2 | |
| CHESS (Moderate)KV Cache Budget=40%2026.02 | 30.2 | |
| CHESS (Aggressive)KV Cache Budget=1%2026.02 | 30.2 | |
| FullKV InferenceKV Cache Budget=100%2026.02 | 28 | |
| CHESS (Conservative)KV Cache Budget=73%2026.02 | 27.7 | |
| SnapKV (Best)KV Cache Budget=4096 tokens2026.02 | 27.3 | |
| KeyDiff (Best)KV Cache Budget=8192 tokens2026.02 | 26.7 |