List your company

Long-context retrieval and tracking on RULER 32K

89.4S-N ScoreSWA+HSA
-3.57620.56244.768.838Oct 20, 2025

Evaluation results

MethodLinks
SWA+HSAEnc=1, CLS=no, Bypass=yes2025.1089.475.690.885.27
SWA+HSAEnc=1, CLS=yes, Bypass=yes2025.1089.272.889.883.93
SWA+HSAEnc=2, CLS=yes, Bypass=yes2025.1089.1473.8491.6184.86
SWA+HSAEnc=2, CLS=no, Bypass=yes2025.1088.1572.3692.284.24
SWA+HSAEnc=0, CLS=no, Bypass=yes2025.1088.0671.0869.276.11
SWA+HSAEnc=2, CLS=yes, Bypass=no2025.1087.4668.1192.8982.82
LandmarkEnc=0, CLS=—, Bypass=—2025.1083152039.33
SWA+HSAEnc=1, CLS=no, Bypass=no2025.108166.287.478.2
SWA+HSAEnc=1, CLS=yes, Bypass=no2025.108165.486.477.6
SWA+HSAEnc=0, CLS=no, Bypass=no2025.1078.9738.812.1443.3
SWA+HSAEnc=2, CLS=no, Bypass=no2025.1078.5865.7587.6677.33
Stick-BreakEnc=0, CLS=—, Bypass=—2025.1073.8824.6331.3443.28
Mamba2Enc=0, CLS=—, Bypass=—2025.101.481.490.41.12
NSAEnc=0, CLS=—, Bypass=—2025.10004.481.49
Llama-YarnEnc=0, CLS=—, Bypass=—2025.100000