Long-context retrieval and tracking on RULER 32M
85.45S-N ScoreSWA+HSA
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SWA+HSAEnc=1, CLS=yes, Bypass=yes2025.10 | 85.45 | 69.09 | 69.09 | 74.54 | |
| SWA+HSAEnc=2, CLS=yes, Bypass=no2025.10 | 82.02 | 24.72 | 61.8 | 56.18 | |
| SWA+HSAEnc=0, CLS=no, Bypass=yes2025.10 | 82.02 | 31.46 | 3.37 | 38.95 | |
| SWA+HSAEnc=2, CLS=no, Bypass=yes2025.10 | 82.02 | 66.29 | 41.57 | 63.29 | |
| SWA+HSAEnc=2, CLS=yes, Bypass=yes2025.10 | 82.02 | 68.54 | 88.76 | 79.77 | |
| SWA+HSAEnc=1, CLS=no, Bypass=no2025.10 | 70.91 | 47.27 | 43.64 | 53.94 | |
| SWA+HSAEnc=2, CLS=no, Bypass=no2025.10 | 67.42 | 42.7 | 70.79 | 60.3 | |
| SWA+HSAEnc=1, CLS=no, Bypass=yes2025.10 | 63.64 | 36.36 | 12.73 | 37.58 | |
| SWA+HSAEnc=0, CLS=no, Bypass=no2025.10 | 61.8 | 1.12 | 0 | 20.97 | |
| SWA+HSAEnc=1, CLS=yes, Bypass=no2025.10 | 54.55 | 21.82 | 30.91 | 35.76 |