In-context retrieval on RULER 4M
96S-N ScoreHiLS-Attn-HoPE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| HiLS-Attn-HoPEParameters=345M, Training context length=8K2026.07 | 96 | 89 | 43 |
| Method | Links | |||
|---|---|---|---|---|
| HiLS-Attn-HoPEParameters=345M, Training context length=8K2026.07 | 96 | 89 | 43 |