List your company
ResearchFormerly WizWand

Classification on LRA ListOps N=2000 (test)

61.48AccuracyFull model
14.31626.560538.80551.0495Apr 22, 2022Nov 18, 2022Jun 16, 2023Jan 13, 2024Aug 10, 2024Mar 8, 2025Oct 5, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Full modelModel Backbone=S5, Pruning Ratio=0%, State Dimension=162024.1161.48
Uniform H_∞Model Backbone=S5, Pruning Ratio=0%, State Dimension=162024.1161.48
Global H_∞Model Backbone=S5, Pruning Ratio=0%, State Dimension=162024.1161.48
LASTModel Backbone=S5, Pruning Ratio=0%, State Dimension=162024.1161.48
Full modelModel Backbone=S4D, Pruning Ratio=0%, State Dimension=642024.1156.42
LASTModel Backbone=S4D, Pruning Ratio=10%, State Dimension=582024.1156.27
Uniform H_∞Model Backbone=S4D, Pruning Ratio=10%, State Dimension=582024.1155.82
Global H_∞Model Backbone=S4D, Pruning Ratio=10%, State Dimension=582024.1149.95
Angulargamma=82025.1042.2
RACEP=2, L=22025.1041.9
RACEP=4, L=42025.1041.6
FlashAttention22025.1041.4
RACEP=3, L=32025.1041.3
YOSOL=162025.1041
Performerrank=2562025.1040.2
Linear2025.1039.6
Paramixer (CHORD)Sequence Length=20002022.0439.57
Linformerk=1282025.1038.9
Transformer-LSReference Source=[25], Sequence Length=20002022.0438.36
Paramixer (CDIL)Sequence Length=20002022.0437.78
LinformerReference Source=[24], Sequence Length=20002022.0437.7
LinformerReference Source=[25], Sequence Length=20002022.0437.38
NyströmformerReference Source=[25], Sequence Length=20002022.0437.34
ReformerReference Source=[24], Sequence Length=20002022.0437.27
LinformerReference Source=[15], Sequence Length=20002022.0437.25
NyströmformerReference Source=[15], Sequence Length=20002022.0437.15
TransformerReference Source=[25], Sequence Length=20002022.0437.13
TransformerReference Source=[15], Sequence Length=20002022.0437.1
RFA-GaussianReference Source=[18], Sequence Length=20002022.0436.8
ReformerReference Source=[25], Sequence Length=20002022.0436.44
TransformerReference Source=[24], Sequence Length=20002022.0436.37
BigBirdReference Source=[24], Sequence Length=20002022.0436.06
LongformerReference Source=[24], Sequence Length=20002022.0435.63
PerformerReference Source=[25], Sequence Length=20002022.0432.78
ReformerReference Source=[15], Sequence Length=20002022.0419.05
PerformerReference Source=[15], Sequence Length=20002022.0418.8
PerformerReference Source=[24], Sequence Length=20002022.0418.01
Sparse TransformerReference Source=[24], Sequence Length=20002022.0417.07
Linear TransformerReference Source=[24], Sequence Length=20002022.0416.13