Feature Interaction Attribution on Dyck-2 15,000 corpus size (test)
0.25Average Relative Ranks (ARR)Archipelago
Evaluation Results
| Method | Links | |
|---|---|---|
| ArchipelagoBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D+2023.06 | 0.25 | |
| HessianBackbone=LSTM, Baseline Type=No baseline2023.06 | 0.413 | |
| ArchipelagoBackbone=LSTM, Baseline Type=Static, Baseline Variant=02023.06 | 0.466 | |
| ArchipelagoBackbone=LSTM, Baseline Type=Static, Baseline Variant=T(x)2023.06 | 0.528 | |
| Hessian x InputBackbone=LSTM, Baseline Type=No baseline2023.06 | 0.542 | |
| ArchipelagoBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D-2023.06 | 0.554 | |
| SIIBackbone=LSTM, Baseline Type=Static, Baseline Variant=02023.06 | 0.555 | |
| STIIBackbone=LSTM, Baseline Type=Static, Baseline Variant=02023.06 | 0.583 | |
| IHBackbone=LSTM, Baseline Type=Static, Baseline Variant=02023.06 | 0.591 | |
| IHBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D-2023.06 | 0.665 | |
| Group AblationBackbone=LSTM, Baseline Type=Static, Baseline Variant=02023.06 | 0.684 | |
| IHBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D+2023.06 | 0.723 | |
| STIIBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D-2023.06 | 0.82 | |
| Group AblationBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~_i)2023.06 | 0.821 | |
| Group AblationBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~)2023.06 | 0.822 | |
| IHBackbone=LSTM, Baseline Type=Static, Baseline Variant=T(x)2023.06 | 0.837 | |
| SIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~)2023.06 | 0.875 | |
| STIIBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D+2023.06 | 0.876 | |
| STIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~)2023.06 | 0.881 | |
| Group AblationBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D-2023.06 | 0.884 | |
| SIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~_i)2023.06 | 0.885 | |
| SIIBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D-2023.06 | 0.895 | |
| STIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~_i)2023.06 | 0.906 | |
| Group AblationBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D+2023.06 | 0.916 | |
| SIIBackbone=LSTM, Baseline Type=Expected, Baseline Variant=D+2023.06 | 0.921 | |
| SIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~|x_S)2023.06 | 0.923 | |
| Group AblationBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~|x_S)2023.06 | 0.938 | |
| STIIBackbone=LSTM, Baseline Type=Interventional, Baseline Variant=P(x~|x_S)2023.06 | 0.952 | |
| Group AblationBackbone=LSTM, Baseline Type=Observational, Baseline Variant=P(x_i|x_S)2023.06 | 0.956 | |
| SIIBackbone=LSTM, Baseline Type=Observational, Baseline Variant=P(x_i|x_S)2023.06 | 0.989 | |
| STIIBackbone=LSTM, Baseline Type=Observational, Baseline Variant=P(x_i|x_S)2023.06 | 0.991 | |
| STIIBackbone=LSTM, Baseline Type=Static, Baseline Variant=T(x)2023.06 | 0.999 | |
| Group AblationBackbone=LSTM, Baseline Type=Static, Baseline Variant=T(x)2023.06 | 1 | |
| SIIBackbone=LSTM, Baseline Type=Static, Baseline Variant=T(x)2023.06 | 1 |