Long-context Understanding on HELMET 128K
46.53Overall ScoreFull-Attention
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Full-AttentionAttention Type=Full2026.06 | 46.53 | 70.4 | 34.6 | 34.6 | — | |
| MSA-CPTAttention Type=Sparse, Bk=128, k=16, KV budget=2,0482026.06 | 45.93 | 72.8 | 32.5 | 32.5 | -0.6 |