Retrieval on RULER 16K context length
82.9Retrieval ScoreMrRoPE-Pro
Evaluation results
| Method | Links | |
|---|---|---|
| MrRoPE-ProModel=Qwen2.5-3B-Instruct, Scale Setting=32K → 128K, Extension Method=MrRoPE-Pro2026.01 | 82.9 | |
| YaRNModel=Qwen2.5-3B-Instruct, Scale Setting=32K → 128K, Extension Method=YaRN2026.01 | 77.7 |