Needle-in-a-haystack 8x original context
52.2AccuracySmolLM-DroPE
Evaluation results
| Method | Links | |
|---|---|---|
| SmolLM-DroPERoPE scaling method=DroPE2025.12 | 52.2 | |
| SmolLM + LongRoPE2RoPE scaling method=LongRoPE22025.12 | 16.45 | |
| SmolLM + YaRNRoPE scaling method=YaRN2025.12 | 12.18 | |
| SmolLM + RoPE-NTKRoPE scaling method=RoPE-NTK2025.12 | 7.19 |