Candidate-ranking retrieval on Needle 8192-token synthetic probes
57.8AccuracyPBB+Full
Evaluation Results
| Method | Links | |
|---|---|---|
| PBB+FullBackbone=Qwen2.5-7B, N (Sample Size)=64, Context Length=8192, Layer Schedule=3:1, Block Size=128, Repair Width=128, Mask Type=union mask2026.06 | 57.8 | |
| SE-Bridge+FullBackbone=Qwen2.5-7B, N (Sample Size)=64, Context Length=8192, Layer Schedule=3:1, Block Size=128, Repair Width=128, Mask Type=union mask2026.06 | 57.8 | |
| SWA+FullBackbone=Qwen2.5-7B, N (Sample Size)=64, Context Length=8192, Layer Schedule=3:1, Block Size=128, Repair Width=1282026.06 | 54.7 | |
| SWA+FullBackbone=Qwen2.5-7B, N (Sample Size)=3122026.06 | 47.1 | |
| PBB+FullBackbone=Qwen2.5-7B, N (Sample Size)=312, Mask Type=union mask2026.06 | 45.5 | |
| SE-Bridge+FullBackbone=Qwen2.5-7B, N (Sample Size)=312, Mask Type=union mask2026.06 | 44.6 | |
| Block+FullBackbone=Qwen2.5-7B, N (Sample Size)=3122026.06 | 40.1 | |
| Block+FullBackbone=Qwen2.5-7B, N (Sample Size)=64, Context Length=8192, Layer Schedule=3:1, Block Size=128, Repair Width=1282026.06 | 31.3 |