List your company
ResearchFormerly WizWand

Math Problem Solving on AIME 2024 (Mean Peak GPU Memory)

15,521Mean Peak GPU Memory (MB)thinKV
15,403.9216,194.2116,984.517,774.79Jun 25, 2026
Updated 4mo ago

Evaluation results

MethodLinks
thinKVKV cache budget=5122026.0615,521
lag-kvKV cache budget=5122026.0615,524
kv-keyKV cache budget=5122026.0615,525
EPIKVKV cache budget=5122026.0615,526
hybrid-seg-hsKV cache budget=5122026.0615,550
h2oKV cache budget=5122026.0615,567
raasKV cache budget=5122026.0615,567
attn×hsKV cache budget=5122026.0615,584
thinKVKV cache budget=10242026.0615,653
hybrid-seg-hsKV cache budget=10242026.0615,672
EPIKVKV cache budget=10242026.0615,712
kv-keyKV cache budget=10242026.0615,712
lag-kvKV cache budget=10242026.0615,712
h2oKV cache budget=10242026.0615,759
raasKV cache budget=10242026.0615,759
attn×hsKV cache budget=10242026.0615,764
thinKVKV cache budget=20482026.0615,953
hybrid-seg-hsKV cache budget=20482026.0615,976
EPIKVKV cache budget=20482026.0616,097
kv-keyKV cache budget=20482026.0616,097
lag-kvKV cache budget=20482026.0616,097
h2oKV cache budget=20482026.0616,170
raasKV cache budget=20482026.0616,170
attn×hsKV cache budget=20482026.0616,173
hybrid-seg-hsKV cache budget=40962026.0616,485
thinKVKV cache budget=40962026.0616,489
lag-kvKV cache budget=40962026.0616,750
kv-keyKV cache budget=40962026.0616,781
EPIKVKV cache budget=40962026.0616,791
h2oKV cache budget=40962026.0616,840
attn×hsKV cache budget=40962026.0616,841
raasKV cache budget=40962026.0616,900
hybrid-seg-hsKV cache budget=81922026.0617,334
thinKVKV cache budget=81922026.0617,374
lag-kvKV cache budget=81922026.0617,647
EPIKVKV cache budget=81922026.0617,918
kv-keyKV cache budget=81922026.0617,919
h2oKV cache budget=81922026.0617,946
attn×hsKV cache budget=81922026.0617,946
raasKV cache budget=81922026.0618,087
none2026.0618,448