Task Predictive Performance on MNIST-Add-Incomp (test)
94.99Accuracy/AUCIntCEM
Evaluation Results
| Method | Links | |
|---|---|---|
| IntCEMFraction of concepts intervened=100%, Intervention Policy=Random2023.09 | 94.99 | |
| IntCEMFraction of concepts intervened=100%, Intervention Policy=Learnt Policy ψ2023.09 | 94.99 | |
| IntCEMFraction of concepts intervened=75%, Intervention Policy=Learnt Policy ψ2023.09 | 94.18 | |
| IntCEMFraction of concepts intervened=75%, Intervention Policy=Random2023.09 | 93.48 | |
| IntCEMFraction of concepts intervened=50%, Intervention Policy=Learnt Policy ψ2023.09 | 92.98 | |
| IntCEMFraction of concepts intervened=50%, Intervention Policy=Random2023.09 | 92.07 | |
| IntCEMFraction of concepts intervened=25%, Intervention Policy=Learnt Policy ψ2023.09 | 91.69 | |
| Joint CBMBottleneck activation function=Sigmoid2023.09 | 91.15 | |
| IntCEMFraction of concepts intervened=25%, Intervention Policy=Random2023.09 | 90.88 | |
| Joint CBMBottleneck activation function=Logit2023.09 | 90.88 | |
| IntCEMlambda_roll=12023.09 | 89.43 | |
| IntCEMlambda_roll=52023.09 | 89.41 | |
| Ind. CBMTraining paradigm=Independent2023.09 | 87.58 | |
| Seq. CBMTraining paradigm=Sequential2023.09 | 87.58 | |
| IntCEMlambda_roll=12023.09 | 87.13 | |
| IntCEMlambda_roll=52023.09 | 87.07 | |
| CEM2023.09 | 86.98 | |
| IntCEMlambda_roll=0.12023.09 | 86.61 | |
| Ind. CBMTraining paradigm=Independent2023.09 | 86.49 | |
| IntCEMlambda_roll=0.12023.09 | 86.46 | |
| CEM2023.09 | 86.09 | |
| Seq. CBMTraining paradigm=Sequential2023.09 | 85.23 | |
| Joint CBMBottleneck activation function=Sigmoid2023.09 | 60.11 | |
| Joint CBMBottleneck activation function=Logit2023.09 | 59.88 |