List your company

KV-Cache Footprint Analysis on Sequence length T=2048 BF16 (inference)

67KV Cache Size (MB)Wiola-360m
52.84148.42244339.58Jul 1, 2026

Evaluation results

MethodLinks
Wiola-360mParams=361M2026.0767
OPT-350MParams=350M2026.07168
Pythia-410MParams=410M2026.07192
GPT-2 XLParams=1.5B2026.07421