List your company
ResearchFormerly WizWand

Long-context understanding on LongBench (32k context length)

19.55Score (32k)SSA
13.382814.983916.58518.1861Nov 25, 2025
Updated 5mo ago

Evaluation results

MethodLinks
SSATraining Protocol=Continual Trained to 32k, Inference Mode=Full Attention, Receptive Field=Full2025.1119.55
SSATraining Protocol=Continual Trained to 32k, Inference Mode=Sparse Attention, Receptive Field=10242025.1119.05
FullAttnTraining Protocol=Continual Trained to 32k, Inference Mode=Full Attention, Receptive Field=Full2025.1118.97
MoBATraining Protocol=Continual Trained to 32k, Inference Mode=Sparse Attention, Receptive Field=10242025.1118.68
SSATraining Protocol=Length Extrapolation (RoPE Scaling), Inference Mode=Sparse Attention, Receptive Field=10242025.1118.58
SSATraining Protocol=Length Extrapolation (RoPE Scaling), Inference Mode=Full Attention, Receptive Field=Full2025.1118.32
SSATraining Protocol=Continual Trained to 32k, Inference Mode=Sparse Attention, Receptive Field=2562025.1118.25
MoBATraining Protocol=Length Extrapolation (RoPE Scaling), Inference Mode=Sparse Attention, Receptive Field=10242025.1118.23
NSATraining Protocol=Continual Trained to 32k, Inference Mode=Sparse Attention, Receptive Field=10242025.1118.08
SSATraining Protocol=Length Extrapolation (RoPE Scaling), Inference Mode=Sparse Attention, Receptive Field=2562025.1117.89
FullAttnTraining Protocol=Length Extrapolation (RoPE Scaling), Inference Mode=Full Attention, Receptive Field=Full2025.1117.71
NSATraining Protocol=Continual Trained to 32k, Inference Mode=Sparse Attention, Receptive Field=2562025.1117.45
NSATraining Protocol=Length Extrapolation (RoPE Scaling), Inference Mode=Sparse Attention, Receptive Field=10242025.1117.36
NSATraining Protocol=Length Extrapolation (RoPE Scaling), Inference Mode=Sparse Attention, Receptive Field=2562025.1117.25
MoBATraining Protocol=Continual Trained to 32k, Inference Mode=Sparse Attention, Receptive Field=2562025.1117.17
MoBATraining Protocol=Length Extrapolation (RoPE Scaling), Inference Mode=Sparse Attention, Receptive Field=2562025.1116.88
FullAttnTraining Protocol=Continual Trained to 32k, Inference Mode=Sparse Attention, Receptive Field=10242025.1116.84
FullAttnTraining Protocol=Length Extrapolation (RoPE Scaling), Inference Mode=Sparse Attention, Receptive Field=10242025.1116.72
FullAttnTraining Protocol=Continual Trained to 32k, Inference Mode=Sparse Attention, Receptive Field=2562025.1114.96
FullAttnTraining Protocol=Length Extrapolation (RoPE Scaling), Inference Mode=Sparse Attention, Receptive Field=2562025.1114.75
MoBATraining Protocol=Continual Trained to 32k, Inference Mode=Full Attention, Receptive Field=Full2025.1114.47
MoBATraining Protocol=Length Extrapolation (RoPE Scaling), Inference Mode=Full Attention, Receptive Field=Full2025.1113.62