In-context retrieval on RULER 1M
100S-N ScoreHiLS-Attn-HoPE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| HiLS-Attn-HoPEParameters=345M, Training context length=8K2026.07 | 100 | 97 | 53 |
| Method | Links | |||
|---|---|---|---|---|
| HiLS-Attn-HoPEParameters=345M, Training context length=8K2026.07 | 100 | 97 | 53 |