List your company
ResearchFormerly WizWand

Classification on LRA Pathfinder N=1024 (test)

95.15AccuracyFull model
55.68265.928576.17586.4215Apr 22, 2022Sep 23, 2022Feb 25, 2023Jul 30, 2023Dec 31, 2023Jun 3, 2024Nov 5, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Full modelModel Backbone=S5, Pruning Ratio=0%, State Dimension=2562024.1195.15
LASTModel Backbone=S5, Pruning Ratio=30%, State Dimension=1792024.1194.45
Full modelModel Backbone=S4D, Pruning Ratio=0%, State Dimension=642024.1187.94
LASTModel Backbone=S4D, Pruning Ratio=10%, State Dimension=582024.1187.83
Uniform H_∞Model Backbone=S4D, Pruning Ratio=10%, State Dimension=582024.1187.59
Global H_∞Model Backbone=S4D, Pruning Ratio=10%, State Dimension=582024.1187.2
Paramixer (CHORD)Sequence Length=10242022.0480.49
PerformerReference Source=[24], Sequence Length=10242022.0477.05
LinformerReference Source=[24], Sequence Length=10242022.0476.34
Linear TransformerReference Source=[24], Sequence Length=10242022.0475.3
BigBirdReference Source=[24], Sequence Length=10242022.0474.87
TransformerReference Source=[15], Sequence Length=10242022.0474.16
Sparse TransformerReference Source=[24], Sequence Length=10242022.0471.71
TransformerReference Source=[24], Sequence Length=10242022.0471.4
Uniform H_∞Model Backbone=S5, Pruning Ratio=30%, State Dimension=1792024.1171.38
NyströmformerReference Source=[15], Sequence Length=10242022.0470.94
PerformerReference Source=[15], Sequence Length=10242022.0469.87
LongformerReference Source=[24], Sequence Length=10242022.0469.71
ReformerReference Source=[15], Sequence Length=10242022.0469.36
ReformerReference Source=[24], Sequence Length=10242022.0468.5
LinformerReference Source=[15], Sequence Length=10242022.0467.6
Paramixer (CDIL)Sequence Length=10242022.0467.13
Global H_∞Model Backbone=S5, Pruning Ratio=30%, State Dimension=1792024.1157.2