Needle-in-a-haystack (2x Original Context)
74.92Needle-in-a-haystack Accuracy (2x Context)SmolLM-DroPE
Evaluation results
| Method | Links | |
|---|---|---|
| SmolLM-DroPERoPE scaling method=DroPE2025.12 | 74.92 | |
| SmolLM + YaRNRoPE scaling method=YaRN2025.12 | 48.25 | |
| SmolLM + LongRoPE2RoPE scaling method=LongRoPE22025.12 | 44.2 | |
| SmolLM + RoPE-NTKRoPE scaling method=RoPE-NTK2025.12 | 29.84 |