Long-context language understanding on LongBench Overall v1
33.2Overall ScoreHiLS-Attn
Evaluation results
| Method | Links | |
|---|---|---|
| HiLS-AttnPositional Embedding=HoPE2026.07 | 33.2 | |
| HiLS-AttnPositional Embedding=NoPE2026.07 | 33.2 | |
| Olmo3-512swa-CPTExtension=YaRN 32K2026.07 | 31.7 | |
| HiLS-AttnPositional Embedding=RoPE2026.07 | 30 | |
| Olmo3-Base2026.07 | 29 | |
| LDM token tuning2026.07 | 28.8 | |
| Olmo3-512swa-CPT2026.07 | 28 |