Task Predictive Performance on CUB Incomp (test)
96.52Accuracy/AUCIntCEM
Evaluation Results
| Method | Links | |
|---|---|---|
| IntCEMFraction of concepts intervened=100%, Intervention Policy=Random2023.09 | 96.52 | |
| IntCEMFraction of concepts intervened=100%, Intervention Policy=Learnt Policy ψ2023.09 | 96.52 | |
| IntCEMFraction of concepts intervened=75%, Intervention Policy=Learnt Policy ψ2023.09 | 94.96 | |
| IntCEMFraction of concepts intervened=75%, Intervention Policy=Random2023.09 | 91.74 | |
| IntCEMFraction of concepts intervened=50%, Intervention Policy=Learnt Policy ψ2023.09 | 90.69 | |
| IntCEMFraction of concepts intervened=50%, Intervention Policy=Random2023.09 | 85.86 | |
| IntCEMFraction of concepts intervened=25%, Intervention Policy=Learnt Policy ψ2023.09 | 81.71 | |
| IntCEMFraction of concepts intervened=25%, Intervention Policy=Random2023.09 | 78.34 | |
| CEM2023.09 | 75.52 | |
| IntCEMlambda_roll=12023.09 | 74.94 | |
| IntCEMlambda_roll=0.12023.09 | 74.66 | |
| IntCEMlambda_roll=52023.09 | 70.39 | |
| Joint CBMBottleneck activation function=Logit2023.09 | 68.42 | |
| Joint CBMBottleneck activation function=Sigmoid2023.09 | 59.73 | |
| Ind. CBMTraining paradigm=Independent2023.09 | 44.82 | |
| Seq. CBMTraining paradigm=Sequential2023.09 | 40 |