Retrieval on RULER 32K context length
78.5Retrieval ScoreMrRoPE-Pro
Evaluation results
| Method | Links | |
|---|---|---|
| MrRoPE-ProModel=Qwen2.5-3B-Instruct, Scale Setting=32K → 128K, Extension Method=MrRoPE-Pro2026.01 | 78.5 | |
| YaRNModel=Qwen2.5-3B-Instruct, Scale Setting=32K → 128K, Extension Method=YaRN2026.01 | 75.6 |