Retrieval-Augmented Generation (Varying Context Lengths)
65.4Performance at 8k Context LengthCLP
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CLPBackbone=Qwen3 8B2026.03 | 65.4 | 63.6 | 60.5 | 59.1 | 52.2 | |
| CLPBackbone=Qwen 2.5 7B2026.03 | 64.7 | 62.1 | 59.9 | 57.3 | 50 | |
| DCABackbone=Qwen3 8B2026.03 | 63.5 | 61.2 | 57.3 | 52.8 | 47.9 | |
| BaseBackbone=Qwen3 8B2026.03 | 63.5 | 61.5 | 58 | 47.9 | 7 | |
| L2ABackbone=Qwen3 8B2026.03 | 63.2 | 61.2 | 60.5 | 58 | 51 | |
| S^2-attnBackbone=Qwen 2.5 7B2026.03 | 63.2 | 60.3 | 56.9 | 53.6 | 44.1 | |
| FlexPrefillBackbone=Qwen3 8B2026.03 | 63 | 60.2 | 58 | 56.8 | 46.5 | |
| SelfExtendBackbone=Qwen 2.5 7B2026.03 | 62.9 | 60.5 | 52.5 | 46.8 | 38.1 | |
| DCABackbone=Qwen 2.5 7B2026.03 | 62.6 | 60.3 | 53.9 | 48.8 | 43.1 | |
| BaseBackbone=Qwen 2.5 7B2026.03 | 62.5 | 60.1 | 54.3 | 43.7 | 27.5 | |
| L2A (Ours)Backbone=Qwen 2.5 7B2026.03 | 62 | 60.4 | 57.7 | 55.1 | 50 | |
| NSABackbone=Qwen 2.5 7B2026.03 | 61.7 | 55.1 | 48.9 | 45 | 39.2 | |
| FlexPrefillBackbone=Qwen 2.5 7B2026.03 | 59.9 | 58.9 | 55 | 53.9 | 49.7 |