List your company
ResearchFormerly WizWand

Mathematical Reasoning on MATH-500 (mean peak GPU memory (MB))

15,508Mean Peak GPU Memory (MB)thinKV
15,479.4815,671.9915,864.516,057.01Jun 25, 2026
Updated 4mo ago

Evaluation results

MethodLinks
thinKVKV cache budget=5122026.0615,508
lag-kvKV cache budget=5122026.0615,524
EPIKVKV cache budget=5122026.0615,525
band-adaptiveKV cache budget=5122026.0615,525
kv-keyKV cache budget=5122026.0615,525
hybrid-seg-hsKV cache budget=5122026.0615,525
h2oKV cache budget=5122026.0615,560
raasKV cache budget=5122026.0615,560
attn×hsKV cache budget=5122026.0615,568
h2oKV cache budget=10242026.0615,574
thinKVKV cache budget=10242026.0615,643
hybrid-seg-hsKV cache budget=10242026.0615,655
EPIKVKV cache budget=10242026.0615,692
kv-keyKV cache budget=10242026.0615,697
lag-kvKV cache budget=10242026.0615,697
band-adaptiveKV cache budget=10242026.0615,698
h2oKV cache budget=20482026.0615,714
raasKV cache budget=10242026.0615,743
attn×hsKV cache budget=10242026.0615,747
h2oKV cache budget=40962026.0615,814
thinKVKV cache budget=20482026.0615,836
hybrid-seg-hsKV cache budget=20482026.0615,857
EPIKVKV cache budget=20482026.0615,880
band-adaptiveKV cache budget=20482026.0615,880
kv-keyKV cache budget=20482026.0615,880
lag-kvKV cache budget=20482026.0615,880
raasKV cache budget=20482026.0615,933
attn×hsKV cache budget=20482026.0615,968
thinKVKV cache budget=40962026.0616,036
EPIKVKV cache budget=40962026.0616,063
band-adaptiveKV cache budget=40962026.0616,064
kv-keyKV cache budget=40962026.0616,064
lag-kvKV cache budget=40962026.0616,064
hybrid-seg-hsKV cache budget=40962026.0616,065
raasKV cache budget=40962026.0616,136
attn×hsKV cache budget=40962026.0616,201
noneKV cache budget=none2026.0616,221