Long-context retrieval on RULER 64K context
84.3AccuracyWindowedManifoldKV
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| WindowedManifoldKVType=Local L2, Window Size=4K2026.02 | 84.3 | 3.2 | — | — | |
| Windowed-4KSamples=6497, Compression Ratio=25%, Window Size=4K2026.02 | 84.29 | — | 5,477 | 0.4 | |
| Windowed-8KSamples=6497, Compression Ratio=25%, Window Size=8K2026.02 | 83.92 | — | 5,453 | 0.4 | |
| WindowedManifoldKVType=Local L2, Window Size=8K2026.02 | 83.9 | 2.8 | — | — | |
| WindowedManifoldKVType=Local L2, Window Size=16K2026.02 | 82.4 | 1.3 | — | — | |
| Windowed-16KSamples=6497, Compression Ratio=25%, Window Size=16K2026.02 | 82.4 | — | 5,354 | 0.5 | |
| Hybrid (0.3)Samples=6497, Compression Ratio=25%, Hybrid Alpha=0.32026.02 | 81.26 | — | 5,280 | 0.5 | |
| KeyDiffType=Cosine2026.02 | 81.1 | — | — | — | |
| KeyDiffSamples=6497, Compression Ratio=25%2026.02 | 81.09 | — | 5,269 | 0.5 | |
| NormalizedSamples=6497, Compression Ratio=25%2026.02 | 81.06 | — | 5,267 | 0.5 | |
| Hybrid (0.5)Samples=6497, Compression Ratio=25%, Hybrid Alpha=0.52026.02 | 79.14 | — | 5,142 | 0.5 | |
| Full AttentionSetting=CPT setting2026.04 | 78.16 | — | — | — | |
| KSASetting=CPT setting2026.04 | 76.09 | — | — | — | |
| Hybrid-KSASetting=CPT setting2026.04 | 76.04 | — | — | — | |
| Hybrid-SWASetting=CPT setting2026.04 | 73.88 | — | — | — | |
| Hybrid-LinearSetting=CPT setting2026.04 | 73.5 | — | — | — | |
| Hybrid-SCASetting=CPT setting2026.04 | 68.88 | — | — | — | |
| ManifoldKVType=Global L22026.02 | 35.2 | -45.9 | — | — | |
| Global ManifoldKVSamples=6497, Compression Ratio=25%, Window Mode=Global2026.02 | 35.2 | — | 2,287 | 0.6 |