Long-context retrieval and tracking on RULER 1M
89.09S-N ScoreSWA+HSA
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SWA+HSAEnc=1, CLS=yes, Bypass=yes2025.10 | 89.09 | 69.09 | 80 | 79.39 | |
| SWA+HSAEnc=2, CLS=yes, Bypass=yes2025.10 | 88.12 | 76.24 | 93.07 | 85.81 | |
| SWA+HSAEnc=2, CLS=no, Bypass=yes2025.10 | 85.15 | 74.26 | 74.26 | 77.89 | |
| SWA+HSAEnc=2, CLS=yes, Bypass=no2025.10 | 83.17 | 46.53 | 82.18 | 70.63 | |
| SWA+HSAEnc=0, CLS=no, Bypass=yes2025.10 | 80.2 | 64.36 | 45.54 | 63.37 | |
| SWA+HSAEnc=1, CLS=no, Bypass=no2025.10 | 72.73 | 58.18 | 72.73 | 67.88 | |
| SWA+HSAEnc=0, CLS=no, Bypass=no2025.10 | 72.28 | 21.78 | 3.96 | 32.67 | |
| SWA+HSAEnc=1, CLS=no, Bypass=yes2025.10 | 69.09 | 56.36 | 45.45 | 56.97 | |
| SWA+HSAEnc=1, CLS=yes, Bypass=no2025.10 | 63.64 | 40 | 54.55 | 52.73 | |
| SWA+HSAEnc=2, CLS=no, Bypass=no2025.10 | 63.37 | 63.37 | 72.28 | 66.34 |