Trace-driven simulation
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Trace-driven simulation No-limit KV cache budget 100k-doc pool Zipf doc popularity
21.33Hit Ratio (Low Skewness)
4
Trace-driven simulation 50 GB KV cache budget 100k-doc pool Zipf doc popularity
20.22Hit Ratio (Low Skewness)
4
Trace-driven simulation 10 GB KV cache budget 100k-doc pool Zipf doc popularity
13.78Low Skewness Hit Ratio
4
Trace-driven simulation 5 GB KV cache budget 100k-doc pool Zipf doc popularity
10.85Hit Ratio (Low Skewness)
4
Trace-driven simulation 1 GB KV cache budget 100k-doc pool Zipf doc popularity
3.47Low Skewness Hit Ratio
4