Task Predictive Performance on MNIST-Add (test)
99.51AccuracyIntCEM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| IntCEMFraction of concepts intervened=100%, Intervention Policy=Random2023.09 | 99.51 | — | — | |
| IntCEMFraction of concepts intervened=100%, Intervention Policy=Learnt Policy ψ2023.09 | 99.51 | — | — | |
| IntCEMFraction of concepts intervened=75%, Intervention Policy=Learnt Policy ψ2023.09 | 98.22 | — | — | |
| IntCEMFraction of concepts intervened=75%, Intervention Policy=Random2023.09 | 97.51 | — | — | |
| IntCEMFraction of concepts intervened=50%, Intervention Policy=Learnt Policy ψ2023.09 | 96.71 | — | — | |
| CEMFraction of concepts intervened=100%, Intervention Policy=Random2023.09 | 96.68 | — | — | |
| IntCEMFraction of concepts intervened=50%, Intervention Policy=Random2023.09 | 95.7 | — | — | |
| CEMFraction of concepts intervened=75%, Intervention Policy=Random2023.09 | 95.01 | — | — | |
| Joint CBM-SigmoidFraction of concepts intervened=100%, Intervention Policy=Random2023.09 | 94.84 | — | — | |
| IntCEMFraction of concepts intervened=25%, Intervention Policy=Learnt Policy ψ2023.09 | 94.75 | — | — | |
| Seq. CBMFraction of concepts intervened=100%, Intervention Policy=Random2023.09 | 94.58 | — | — | |
| IntCEMFraction of concepts intervened=25%, Intervention Policy=Random2023.09 | 93.78 | — | — | |
| CEMFraction of concepts intervened=50%, Intervention Policy=Random2023.09 | 93.36 | — | — | |
| Seq. CBMFraction of concepts intervened=75%, Intervention Policy=Random2023.09 | 92.58 | — | — | |
| CEMFraction of concepts intervened=25%, Intervention Policy=Random2023.09 | 91.66 | — | — | |
| Joint CBM-SigmoidFraction of concepts intervened=75%, Intervention Policy=Random2023.09 | 91.24 | — | — | |
| Seq. CBMFraction of concepts intervened=50%, Intervention Policy=Random2023.09 | 90.87 | — | — | |
| Seq. CBMFraction of concepts intervened=25%, Intervention Policy=Random2023.09 | 88.88 | — | — | |
| Joint CBM-SigmoidFraction of concepts intervened=50%, Intervention Policy=Random2023.09 | 88.66 | — | — | |
| Ind. CBMFraction of concepts intervened=100%, Intervention Policy=Random2023.09 | 88.43 | — | — | |
| Ind. CBMFraction of concepts intervened=75%, Intervention Policy=Random2023.09 | 86.97 | — | — | |
| Joint CBM-SigmoidFraction of concepts intervened=25%, Intervention Policy=Random2023.09 | 86.47 | — | — | |
| Ind. CBMFraction of concepts intervened=50%, Intervention Policy=Random2023.09 | 85.71 | — | — | |
| Ind. CBMFraction of concepts intervened=25%, Intervention Policy=Random2023.09 | 84.11 | — | — | |
| Joint CBM-LogitFraction of concepts intervened=100%, Intervention Policy=Random2023.09 | 81.92 | — | — | |
| Joint CBM-LogitFraction of concepts intervened=75%, Intervention Policy=Random2023.09 | 81.31 | — | — | |
| Joint CBM-LogitFraction of concepts intervened=50%, Intervention Policy=Random2023.09 | 80.69 | — | — | |
| Joint CBM-LogitFraction of concepts intervened=25%, Intervention Policy=Random2023.09 | 79.86 | — | — | |
| CEM2023.09 | — | 86.61 | — | |
| CEM2023.09 | — | — | 89.73 | |
| Ind. CBMTraining paradigm=Independent2023.09 | — | 87.66 | — | |
| Ind. CBMTraining paradigm=Independent2023.09 | — | — | 82.29 | |
| IntCEMlambda_roll=52023.09 | — | 90.74 | — | |
| IntCEMlambda_roll=12023.09 | — | 89.63 | — | |
| IntCEMlambda_roll=0.12023.09 | — | 90.13 | — | |
| IntCEMlambda_roll=52023.09 | — | — | 89.43 | |
| IntCEMlambda_roll=12023.09 | — | — | 89.63 | |
| IntCEMlambda_roll=0.12023.09 | — | — | 89.73 | |
| Joint CBMBottleneck activation function=Sigmoid2023.09 | — | 62.91 | — | |
| Joint CBMBottleneck activation function=Logit2023.09 | — | 61.41 | — | |
| Joint CBMBottleneck activation function=Sigmoid2023.09 | — | — | 89.21 | |
| Joint CBMBottleneck activation function=Logit2023.09 | — | — | 82.29 | |
| Seq. CBMTraining paradigm=Sequential2023.09 | — | 83.2 | — | |
| Seq. CBMTraining paradigm=Sequential2023.09 | — | — | 82.29 |