Retrieval on RULER 8K context length
82.3Retrieval ScoreMrRoPE-Pro
Evaluation results
| Method | Links | |
|---|---|---|
| MrRoPE-ProModel=Qwen2.5-3B-Instruct, Scale Setting=32K → 128K, Extension Method=MrRoPE-Pro2026.01 | 82.3 | |
| YaRNModel=Qwen2.5-3B-Instruct, Scale Setting=32K → 128K, Extension Method=YaRN2026.01 | 78.1 |