Long-context Question Answering on ∞Bench
78.46AccuracyStateLM-14B-RL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| StateLM-14B-RLContext=32K2026.02 | 78.46 | — | — | |
| StateLM-14BContext=32K2026.02 | 77.44 | — | — | |
| Qwen3-14BContext=128K2026.02 | 74.96 | — | — | |
| RL-MemoryAgent-14BContext=32K2026.02 | 74.24 | — | — | |
| Qwen3-235B (w/ Pensieve)Context=256K2026.02 | 73.36 | — | — | |
| StateLM-8B-RLContext=32K2026.02 | 73.07 | — | — | |
| StateLM-8BContext=32K2026.02 | 70.16 | — | — | |
| StateLM-4BContext=32K2026.02 | 67.25 | — | — | |
| Qwen3-8BContext=128K2026.02 | 66.81 | — | — | |
| RL-MemoryAgent-7BContext=32K2026.02 | 62.45 | — | — | |
| Qwen3-4BContext=128K2026.02 | 59.97 | — | — | |
| ReadAgent-14BContext=32K2026.02 | 34.06 | — | — | |
| ReadAgent-8BContext=32K2026.02 | 24.02 | — | — | |
| Qwen3-0.6BAttention=Full attention, Avg. Len.=128k2026.02 | — | 1.76 | 2.18 | |
| Qwen3-0.6B-ALLMEMArchitecture=ALLMEM, Avg. Len.=128k2026.02 | — | 8.53 | 12.54 | |
| Qwen3-0.6B-MambaArchitecture=Hybrid Mamba-2, Avg. Len.=128k2026.02 | — | 6 | 8.5 | |
| Qwen3-0.6B-SWA-SinksAttention=sliding-window, Window Length=8k, Attention Sinks=128, Avg. Len.=128k2026.02 | — | 3.7 | 4.05 |