Long-context Understanding on RULER shorter context lengths ≤32K
86.43Performance Score (8K Context)Qwen2.5-3B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-3BEvaluation Stage=Before SFT2026.04 | 86.43 | 82.24 | 76.82 | 81.83 | |
| PolicyLongBackbone=Qwen2.5-3B, Evaluation Stage=Before SFT2026.04 | 86.05 | 82 | 78.23 | 82.09 | |
| NExtLongBackbone=Qwen2.5-3B, Evaluation Stage=Before SFT2026.04 | 85.82 | 80.73 | 75.9 | 80.82 | |
| EntropyLongBackbone=Qwen2.5-3B, Evaluation Stage=Before SFT2026.04 | 85.2 | 80.49 | 75.67 | 80.45 |