List your company
ResearchFormerly WizWand

Feature Interaction Attribution on Dyck-2 15,000 corpus size (test)

0.25Average Relative Ranks (ARR)Archipelago
0.220.42250.6250.8275Jun 21, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ArchipelagoBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D+2023.060.25
HessianBackbone=LSTM, Baseline Type=No baseline2023.060.413
ArchipelagoBackbone=LSTM, Baseline Type=Static, Baseline Variant=02023.060.466
ArchipelagoBackbone=LSTM, Baseline Type=Static, Baseline Variant=T(x)2023.060.528
Hessian x InputBackbone=LSTM, Baseline Type=No baseline2023.060.542
ArchipelagoBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D-2023.060.554
SIIBackbone=LSTM, Baseline Type=Static, Baseline Variant=02023.060.555
STIIBackbone=LSTM, Baseline Type=Static, Baseline Variant=02023.060.583
IHBackbone=LSTM, Baseline Type=Static, Baseline Variant=02023.060.591
IHBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D-2023.060.665
Group AblationBackbone=LSTM, Baseline Type=Static, Baseline Variant=02023.060.684
IHBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D+2023.060.723
STIIBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D-2023.060.82
Group AblationBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~_i)2023.060.821
Group AblationBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~)2023.060.822
IHBackbone=LSTM, Baseline Type=Static, Baseline Variant=T(x)2023.060.837
SIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~)2023.060.875
STIIBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D+2023.060.876
STIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~)2023.060.881
Group AblationBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D-2023.060.884
SIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~_i)2023.060.885
SIIBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D-2023.060.895
STIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~_i)2023.060.906
Group AblationBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D+2023.060.916
SIIBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D+2023.060.921
SIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~|x_S)2023.060.923
Group AblationBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~|x_S)2023.060.938
STIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~|x_S)2023.060.952
Group AblationBackbone=LSTM, Baseline Type=Observational, Baseline Variant=P(x_i|x_S)2023.060.956
SIIBackbone=LSTM, Baseline Type=Observational, Baseline Variant=P(x_i|x_S)2023.060.989
STIIBackbone=LSTM, Baseline Type=Observational, Baseline Variant=P(x_i|x_S)2023.060.991
STIIBackbone=LSTM, Baseline Type=Static, Baseline Variant=T(x)2023.060.999
Group AblationBackbone=LSTM, Baseline Type=Static, Baseline Variant=T(x)2023.061
SIIBackbone=LSTM, Baseline Type=Static, Baseline Variant=T(x)2023.061