Long-context Retrieval on NIAH (NIAH Score)
100NIAH ScoreS2: S1 → SFT(2) 60B Targeted (all-attention)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| S2: S1 → SFT(2) 60B Targeted (all-attention)Campaign=S2: S1 → SFT(2) 60B Targeted 8 placements, Config=all-attention, @32k speedup=1.0×2026.04 | 100 | 82.6 | |
| S1: Distil. 69B (all-attention)Campaign=S1: Distil. 69B, Config=all-attention, @32k speedup=1.0×2026.04 | 99.8 | 80.4 |