Math Problem Solving on AIME 2024 (Mean Peak GPU Memory)
15,521Mean Peak GPU Memory (MB)thinKV
Evaluation Results
| Method | Links | |
|---|---|---|
| thinKVKV cache budget=5122026.06 | 15,521 | |
| lag-kvKV cache budget=5122026.06 | 15,524 | |
| kv-keyKV cache budget=5122026.06 | 15,525 | |
| EPIKVKV cache budget=5122026.06 | 15,526 | |
| hybrid-seg-hsKV cache budget=5122026.06 | 15,550 | |
| h2oKV cache budget=5122026.06 | 15,567 | |
| raasKV cache budget=5122026.06 | 15,567 | |
| attn×hsKV cache budget=5122026.06 | 15,584 | |
| thinKVKV cache budget=10242026.06 | 15,653 | |
| hybrid-seg-hsKV cache budget=10242026.06 | 15,672 | |
| EPIKVKV cache budget=10242026.06 | 15,712 | |
| kv-keyKV cache budget=10242026.06 | 15,712 | |
| lag-kvKV cache budget=10242026.06 | 15,712 | |
| h2oKV cache budget=10242026.06 | 15,759 | |
| raasKV cache budget=10242026.06 | 15,759 | |
| attn×hsKV cache budget=10242026.06 | 15,764 | |
| thinKVKV cache budget=20482026.06 | 15,953 | |
| hybrid-seg-hsKV cache budget=20482026.06 | 15,976 | |
| EPIKVKV cache budget=20482026.06 | 16,097 | |
| kv-keyKV cache budget=20482026.06 | 16,097 | |
| lag-kvKV cache budget=20482026.06 | 16,097 | |
| h2oKV cache budget=20482026.06 | 16,170 | |
| raasKV cache budget=20482026.06 | 16,170 | |
| attn×hsKV cache budget=20482026.06 | 16,173 | |
| hybrid-seg-hsKV cache budget=40962026.06 | 16,485 | |
| thinKVKV cache budget=40962026.06 | 16,489 | |
| lag-kvKV cache budget=40962026.06 | 16,750 | |
| kv-keyKV cache budget=40962026.06 | 16,781 | |
| EPIKVKV cache budget=40962026.06 | 16,791 | |
| h2oKV cache budget=40962026.06 | 16,840 | |
| attn×hsKV cache budget=40962026.06 | 16,841 | |
| raasKV cache budget=40962026.06 | 16,900 | |
| hybrid-seg-hsKV cache budget=81922026.06 | 17,334 | |
| thinKVKV cache budget=81922026.06 | 17,374 | |
| lag-kvKV cache budget=81922026.06 | 17,647 | |
| EPIKVKV cache budget=81922026.06 | 17,918 | |
| kv-keyKV cache budget=81922026.06 | 17,919 | |
| h2oKV cache budget=81922026.06 | 17,946 | |
| attn×hsKV cache budget=81922026.06 | 17,946 | |
| raasKV cache budget=81922026.06 | 18,087 | |
| none2026.06 | 18,448 |