List your company
ResearchFormerly WizWand

Mathematical Reasoning on MATH 500 (mean wall-clock time)

40.2Mean Wall-Clock Timeh2o
6.876231.813456.75681.687Jun 25, 2026
Updated 4mo ago

Evaluation results

MethodLinks
h2oKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.0640.2
h2oKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.0671.4
h2oKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.0691.4
kv-keyKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.06113.4
kv-valKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.06113.5
band-adaptiveKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.06113.8
lag-kv-keyKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.06116.3
lag-kvKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.06119.5
EPIKVKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.06125
hs-varianceKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.06128.8
kv-valKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.06152.5
band-adaptiveKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.06155.3
kv-keyKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.06156
lag-kv-keyKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.06158.3
lag-kvKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.06163.4
noneKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06180
EPIKVKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.06181.9
hs-varianceKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.06181.9
hybrid-seg-hsKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.06193.8
attn×hsKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.06211.5
hybrid-seg-hsKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.06222.5
band-adaptiveKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06246.3
raasKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.06246.6
kv-keyKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06248.7
kv-valKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06249.4
lag-kv-keyKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06251
lag-kvKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06252
lag-kvKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06267.5
lag-kv-keyKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06269.1
kv-valKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06271.5
band-adaptiveKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06272.4
kv-keyKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06273.5
EPIKVKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06276.9
hs-varianceKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06282.2
attn×hsKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.06290.5
hybrid-seg-hsKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06309.2
raasKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.06317.8
EPIKVKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06319.9
hs-varianceKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06342.1
thinKVKV-cache budget=4096, Hardware=RTX A6000, GPU count per job=12026.06344.6
thinKVKV-cache budget=2048, Hardware=RTX A6000, GPU count per job=12026.06399.4
attn×hsKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06414.4
thinKVKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06416.5
hybrid-seg-hsKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06420.9
raasKV-cache budget=1024, Hardware=RTX A6000, GPU count per job=12026.06515.8
thinKVKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06520.2
attn×hsKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06572.1
h2oKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06628
raasKV-cache budget=512, Hardware=RTX A6000, GPU count per job=12026.06873.3