LLM KV
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
LLM KV BF16
20.6Compression Time (ms)
9
LLM KV FP16
16.5Compression Time (ms)
9
LLM KV BF16
43.03Average Space Savings
9
LLM KV FP16
38.91Average Space Savings
9
Loading the SOTA2 catalog…