Mathematical Reasoning on AIME 24 (Acc, Gen. Len)
76.7AccuracyFull Attention
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Full AttentionSelection Method=Full Attn, Budget=None2026.06 | 76.7 | 13,104 | |
| RKV + HARD-KVSelection Method=RKV, Config=+ Ours, Budget=40962026.06 | 66.7 | 17,030 | |
| SnapKV + HARD-KVSelection Method=SnapKV, Config=+ Ours, Budget=40962026.06 | 60 | 21,549 | |
| RKVSelection Method=RKV, Config=Base, Budget=40962026.06 | 60 | 19,911 | |
| SnapKVSelection Method=SnapKV, Config=Base, Budget=40962026.06 | 53.3 | 24,862 | |
| Vanilla + HARD-KVSelection Method=Vanilla, Config=+ Ours, Budget=40962026.06 | 50 | 22,164 | |
| VanillaSelection Method=Vanilla, Config=Base, Budget=40962026.06 | 40 | 25,918 |