List your company

Long-context understanding on RULER 1000 tokens

94.5NIAHSteered Mamba
42.125655.722869.3282.9172Feb 26, 2026

Evaluation results

MethodLinks
Steered MambaModel Size=2.8B2026.0294.5709686.83
GPT-22026.0294595870.33
Stable-MambaModel Size=2.8B2026.0293.751009997.58
Steered MambaModel Size=130M2026.0292677678.33
Stable-MambaModel Size=1.4B2026.0291.5510010097.18
Steered MambaModel Size=1.4B2026.02917295.586.17
MambaModel Size=2.8B2026.0290.43709585.14
Stable-MambaModel Size=130M2026.0290738281.67
MambaModel Size=1.4B2026.0287.71719484.24
MambaModel Size=130M2026.02846766.772.57
Mamba-22026.0270.43408966.48
DenseMamba2026.0262457861.67
MiniPLM-MambaModel Size=130M2026.0246367753
Hyena2026.0244.1413.54132.88