List your company

ResearchFormerly WizWand

KV Cache Efficiency

Benchmarks

DatasetSOTA methodMetricTrendResultsLast updated

Trace-driven simulation No-limit KV cache budget 100k-doc pool Zipf doc popularity

21.33Hit Ratio (Low Skewness)

4

Jun 4, 2026

Trace-driven simulation 50 GB KV cache budget 100k-doc pool Zipf doc popularity

20.22Hit Ratio (Low Skewness)

4

Jun 4, 2026

Trace-driven simulation 10 GB KV cache budget 100k-doc pool Zipf doc popularity

13.78Low Skewness Hit Ratio

4

Jun 4, 2026

Trace-driven simulation 5 GB KV cache budget 100k-doc pool Zipf doc popularity

10.85Hit Ratio (Low Skewness)

4

Jun 4, 2026

Trace-driven simulation 1 GB KV cache budget 100k-doc pool Zipf doc popularity

3.47Low Skewness Hit Ratio

4

Jun 4, 2026