Mathematical Reasoning on AIME24 (Accuracy, Throughput, Speedup)
57.1AccuracyFull Attn.
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Full Attn.KV Budget=–, Backbone=Qwen3-8B2026.04 | 57.1 | 222.8 | — | |
| TriAttn.KV Budget=4096, Backbone=Qwen3-8B2026.04 | 54.6 | 413.9 | 1.9 |
| Method | Links | |||
|---|---|---|---|---|
| Full Attn.KV Budget=–, Backbone=Qwen3-8B2026.04 | 57.1 | 222.8 | — | |
| TriAttn.KV Budget=4096, Backbone=Qwen3-8B2026.04 | 54.6 | 413.9 | 1.9 |