Feature Attribution Plausibility on MDACE (test)
41.7PAttention
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| AttentionModel=BS2024.06 | 41.7 | 42.9 | 42.2 | 37.3 | 13.5 | 60.5 | 72.3 | 46.1 | 32.3 | 45.3 | |
| AttentionModel=BS2024.06 | 41.7 | 42.9 | 42.2 | 37.3 | 13.5 | 60.5 | 72.3 | 46.1 | 32.3 | 45.3 | |
| AttInGradModel=BU2024.06 | 40.7 | 42.5 | 41.5 | 37.1 | 3 | 59.3 | 74.9 | 43.5 | 32 | 44.9 | |
| AttInGradModel=BU2024.06 | 40.7 | 42.5 | 41.5 | 37.1 | 3 | 59.3 | 74.9 | 43.5 | 32 | 44.9 | |
| AttInGradModel=BS2024.06 | 40.6 | 45.9 | 43 | 38.8 | 1.2 | 63.9 | 79 | 45.7 | 33.3 | 46.6 | |
| AttInGradModel=BS2024.06 | 40.6 | 45.9 | 43 | 38.8 | 1.2 | 63.9 | 79 | 45.7 | 33.3 | 46.6 | |
| AttInGradModel=TM2024.06 | 40.2 | 43.9 | 41.9 | 37.8 | 2.8 | 60.5 | 75.9 | 44 | 32.5 | 45.5 | |
| AttInGradModel=TM2024.06 | 40.2 | 43.9 | 41.9 | 37.8 | 2.8 | 60.5 | 75.9 | 44 | 32.5 | 45.5 | |
| AttInGradModel=IGR2024.06 | 38.8 | 44 | 41.2 | 37.2 | 2.3 | 60.3 | 74.5 | 43.3 | 31.9 | 44.7 | |
| AttInGradModel=IGR2024.06 | 38.8 | 44 | 41.2 | 37.2 | 2.3 | 60.3 | 74.5 | 43.3 | 31.9 | 44.7 | |
| α∇αModel=BS2024.06 | 37.4 | 37.8 | 37.4 | 31.5 | 11.9 | 55 | 69.9 | 39.7 | 29.4 | 41.2 | |
| AttInGradModel=PGD2024.06 | 37.1 | 42.5 | 39.3 | 34.7 | 2.3 | 57.7 | 72.7 | 39.6 | 30.9 | 43.3 | |
| AttInGradModel=PGD2024.06 | 37.1 | 42.5 | 39.3 | 34.7 | 2.3 | 57.7 | 72.7 | 39.6 | 30.9 | 43.3 | |
| AttentionModel=TM2024.06 | 36.5 | 37.8 | 37 | 31.7 | 21.7 | 53.3 | 63.3 | 40.1 | 29.1 | 40.8 | |
| AttentionModel=TM2024.06 | 36.5 | 37.8 | 37 | 31.7 | 21.7 | 53.3 | 63.3 | 40.1 | 29.1 | 40.8 | |
| AttentionModel=BU2024.06 | 35.9 | 37.7 | 36.6 | 31.4 | 21.1 | 53.2 | 63.4 | 39.3 | 28.8 | 40.3 | |
| AttentionModel=BU2024.06 | 35.9 | 37.7 | 36.6 | 31.4 | 21.1 | 53.2 | 63.4 | 39.3 | 28.8 | 40.3 | |
| AttentionModel=IGR2024.06 | 35.5 | 40.4 | 37.7 | 32.4 | 19.4 | 55.5 | 64.5 | 40 | 29.2 | 40.9 | |
| AttentionModel=IGR2024.06 | 35.5 | 40.4 | 37.7 | 32.4 | 19.4 | 55.5 | 64.5 | 40 | 29.2 | 40.9 | |
| α∇αModel=IGR2024.06 | 35.1 | 38.2 | 36.3 | 30.8 | 15 | 54.2 | 65.7 | 38.3 | 28.9 | 40.5 | |
| α∇αModel=TM2024.06 | 34.6 | 36.5 | 35.2 | 29.1 | 16.1 | 52.2 | 65 | 36.3 | 27.8 | 39 | |
| α∇αModel=BU2024.06 | 34.4 | 36.2 | 34.8 | 29 | 16 | 51.8 | 64.7 | 36.2 | 27.4 | 38.4 | |
| Integrated Gradients (IntGrad)Model=TM2024.06 | 33.1 | 34 | 33.4 | 27.5 | 5.4 | 51 | 65.5 | 35.3 | 27.6 | 38.7 | |
| IGModel=TM2024.06 | 33.1 | 34 | 33.4 | 27.5 | 5.4 | 51 | 65.5 | 35.3 | 27.6 | 38.7 | |
| AttentionModel=PGD2024.06 | 33 | 38.4 | 35.4 | 30 | 19.1 | 51.5 | 61.1 | 35.9 | 27.7 | 38.9 | |
| AttentionModel=PGD2024.06 | 33 | 38.4 | 35.4 | 30 | 19.1 | 51.5 | 61.1 | 35.9 | 27.7 | 38.9 | |
| α∇αModel=PGD2024.06 | 32.7 | 37.9 | 34.9 | 29.1 | 14.3 | 52.8 | 64.7 | 35.7 | 28.4 | 39.8 | |
| Integrated Gradients (IntGrad)Model=IGR2024.06 | 32.6 | 33.8 | 33.1 | 26.6 | 5.2 | 49.7 | 64.7 | 34.9 | 27.6 | 38.7 | |
| IGModel=IGR2024.06 | 32.6 | 33.8 | 33.1 | 26.6 | 5.2 | 49.7 | 64.7 | 34.9 | 27.6 | 38.7 | |
| InputXGradModel=IGR2024.06 | 32.4 | 33.8 | 33 | 27 | 9.7 | 48.5 | 64.6 | 32.8 | 27.4 | 38.4 | |
| InputXGradModel=TM2024.06 | 32.4 | 34.1 | 33.1 | 26.2 | 8.6 | 48.5 | 64.8 | 32.6 | 27.4 | 38.3 | |
| InputXGradModel=IGR2024.06 | 32.4 | 33.8 | 33 | 27 | 9.7 | 48.5 | 64.6 | 32.8 | 27.4 | 38.4 | |
| InputXGradModel=TM2024.06 | 32.4 | 34.1 | 33.1 | 26.2 | 8.6 | 48.5 | 64.8 | 32.6 | 27.4 | 38.3 | |
| Integrated Gradients (IntGrad)Model=BU2024.06 | 31.3 | 32.8 | 31.9 | 26 | 5.2 | 49.4 | 64.4 | 33.9 | 26.5 | 37.1 | |
| IGModel=BU2024.06 | 31.3 | 32.8 | 31.9 | 26 | 5.2 | 49.4 | 64.4 | 33.9 | 26.5 | 37.1 | |
| DeepliftModel=BU2024.06 | 31.2 | 31.4 | 31.2 | 24.1 | 9.1 | 45.1 | 61.7 | 30.9 | 25.8 | 36.1 | |
| DeepliftModel=BU2024.06 | 31.2 | 31.4 | 31.2 | 24.1 | 9.1 | 45.1 | 61.7 | 30.9 | 25.8 | 36.1 | |
| InputXGradModel=BU2024.06 | 31 | 32.7 | 31.6 | 24.8 | 9.5 | 46.4 | 62.3 | 31.7 | 26.3 | 36.9 | |
| DeepliftModel=IGR2024.06 | 31 | 33.7 | 32.2 | 25.9 | 8.6 | 48.3 | 64.8 | 31.6 | 26.7 | 37.4 | |
| InputXGradModel=BU2024.06 | 31 | 32.7 | 31.6 | 24.8 | 9.5 | 46.4 | 62.3 | 31.7 | 26.3 | 36.9 | |
| DeepliftModel=IGR2024.06 | 31 | 33.7 | 32.2 | 25.9 | 8.6 | 48.3 | 64.8 | 31.6 | 26.7 | 37.4 | |
| Integrated Gradients (IntGrad)Model=BS2024.06 | 30.9 | 33.9 | 32.2 | 26.2 | 4.8 | 50.8 | 65.9 | 34.2 | 27.4 | 38.4 | |
| IGModel=BS2024.06 | 30.9 | 33.9 | 32.2 | 26.2 | 4.8 | 50.8 | 65.9 | 34.2 | 27.4 | 38.4 | |
| InputXGradModel=BS2024.06 | 30.7 | 33.7 | 32 | 24.9 | 7.3 | 48.5 | 64 | 32.2 | 26.6 | 37.3 | |
| InputXGradModel=BS2024.06 | 30.7 | 33.7 | 32 | 24.9 | 7.3 | 48.5 | 64 | 32.2 | 26.6 | 37.3 | |
| DeepliftModel=TM2024.06 | 30.2 | 34.8 | 32.2 | 25.1 | 6.8 | 49.1 | 65.7 | 31.4 | 26.6 | 37.3 | |
| DeepliftModel=TM2024.06 | 30.2 | 34.8 | 32.2 | 25.1 | 6.8 | 49.1 | 65.7 | 31.4 | 26.6 | 37.3 | |
| InputXGradModel=PGD2024.06 | 30.1 | 32.9 | 31.4 | 24.8 | 9.3 | 46.6 | 62.6 | 31.4 | 26.1 | 36.6 | |
| InputXGradModel=PGD2024.06 | 30.1 | 32.9 | 31.4 | 24.8 | 9.3 | 46.6 | 62.6 | 31.4 | 26.1 | 36.6 | |
| Integrated Gradients (IntGrad)Model=PGD2024.06 | 30 | 33.5 | 31.4 | 25.4 | 5.1 | 49.7 | 64.5 | 33.6 | 26.4 | 36.9 | |
| IGModel=PGD2024.06 | 30 | 33.5 | 31.4 | 25.4 | 5.1 | 49.7 | 64.5 | 33.6 | 26.4 | 36.9 | |
| DeepliftModel=PGD2024.06 | 29.4 | 32.8 | 30.9 | 23.9 | 8.1 | 46.7 | 63.3 | 30.7 | 25.5 | 35.8 | |
| DeepliftModel=PGD2024.06 | 29.4 | 32.8 | 30.9 | 23.9 | 8.1 | 46.7 | 63.3 | 30.7 | 25.5 | 35.8 | |
| DeepliftModel=BS2024.06 | 29.2 | 34.2 | 31.3 | 24.1 | 6.4 | 48.9 | 65.2 | 31.1 | 26.2 | 36.7 | |
| DeepliftModel=BS2024.06 | 29.2 | 34.2 | 31.3 | 24.1 | 6.4 | 48.9 | 65.2 | 31.1 | 26.2 | 36.7 | |
| RolloutModel=BU2024.06 | 1.7 | 24.1 | 3.1 | 0.3 | 0 | 25.1 | 31.4 | 0.3 | 0.5 | 0.7 | |
| RolloutModel=IGR2024.06 | 1.7 | 24.3 | 3.1 | 0.3 | 0 | 25.4 | 31.6 | 0.3 | 0.5 | 0.7 | |
| RolloutModel=TM2024.06 | 1.7 | 25.3 | 3.2 | 0.3 | 0 | 26.3 | 32.4 | 0.3 | 0.5 | 0.7 | |
| RolloutModel=PGD2024.06 | 1.7 | 24.8 | 3.2 | 0.3 | 0 | 26 | 32.6 | 0.3 | 0.5 | 0.6 | |
| RolloutModel=BS2024.06 | 1.6 | 23.4 | 2.9 | 0.3 | 0 | 25 | 32.2 | 0.4 | 0.5 | 0.7 | |
| RandModel=BU2024.06 | 0.4 | 1 | 0.4 | 0 | 64.7 | 1.1 | 2.3 | 0.1 | 0.1 | 0.2 | |
| RandModel=IGR2024.06 | 0.4 | 0.7 | 0.4 | 0 | 80.3 | 1 | 1.9 | 0.1 | 0.1 | 0.2 | |
| RandModel=TM2024.06 | 0.4 | 1 | 0.4 | 0.4 | 65.3 | 1.2 | 2.4 | 0.1 | 0.1 | 0.1 | |
| RandModel=PGD2024.06 | 0.4 | 0.8 | 0.4 | 0 | 76.1 | 1.1 | 2 | 0.1 | 0.1 | 0.2 | |
| RandModel=BS2024.06 | 0.3 | 1.3 | 0.4 | 0 | 49.2 | 1.6 | 3.2 | 0.1 | 0.1 | 0.1 |