Long-context retrieval and tracking on RULER 8M
79.21S-NSWA+HSA
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SWA+HSAEnc=2, CLS=yes, Bypass=yes2025.10 | 79.21 | 77.23 | 90.1 | 82.18 | |
| SWA+HSAEnc=2, CLS=yes, Bypass=no2025.10 | 78.22 | 28.71 | 80.2 | 62.38 | |
| SWA+HSAEnc=2, CLS=no, Bypass=yes2025.10 | 78.22 | 65.35 | 65.35 | 69.64 | |
| SWA+HSAEnc=1, CLS=yes, Bypass=yes2025.10 | 72.73 | 78.18 | 76.36 | 75.76 | |
| SWA+HSAEnc=0, CLS=no, Bypass=yes2025.10 | 71.29 | 46.53 | 15.84 | 44.55 | |
| SWA+HSAEnc=1, CLS=no, Bypass=no2025.10 | 69.09 | 34.55 | 58.18 | 53.94 | |
| SWA+HSAEnc=1, CLS=yes, Bypass=no2025.10 | 69.09 | 38.18 | 49.09 | 52.12 | |
| SWA+HSAEnc=0, CLS=no, Bypass=no2025.10 | 61.39 | 6.93 | 1.98 | 23.43 | |
| SWA+HSAEnc=2, CLS=no, Bypass=no2025.10 | 58.42 | 48.51 | 66.34 | 57.76 | |
| SWA+HSAEnc=1, CLS=no, Bypass=yes2025.10 | 58.18 | 30.91 | 10.91 | 33.33 |