List your company
ResearchFormerly WizWand

Task Predictive Performance on MNIST-Add-Incomp (test)

94.99Accuracy/AUCIntCEM
58.475667.955377.43586.9147Sep 29, 2023
Updated 8mo ago

Evaluation results

MethodLinks
IntCEMFraction of concepts intervened=100%, Intervention Policy=Random2023.0994.99
IntCEMFraction of concepts intervened=100%, Intervention Policy=Learnt Policy ψ2023.0994.99
IntCEMFraction of concepts intervened=75%, Intervention Policy=Learnt Policy ψ2023.0994.18
IntCEMFraction of concepts intervened=75%, Intervention Policy=Random2023.0993.48
IntCEMFraction of concepts intervened=50%, Intervention Policy=Learnt Policy ψ2023.0992.98
IntCEMFraction of concepts intervened=50%, Intervention Policy=Random2023.0992.07
IntCEMFraction of concepts intervened=25%, Intervention Policy=Learnt Policy ψ2023.0991.69
Joint CBMBottleneck activation function=Sigmoid2023.0991.15
IntCEMFraction of concepts intervened=25%, Intervention Policy=Random2023.0990.88
Joint CBMBottleneck activation function=Logit2023.0990.88
IntCEMlambda_roll=12023.0989.43
IntCEMlambda_roll=52023.0989.41
Ind. CBMTraining paradigm=Independent2023.0987.58
Seq. CBMTraining paradigm=Sequential2023.0987.58
IntCEMlambda_roll=12023.0987.13
IntCEMlambda_roll=52023.0987.07
CEM2023.0986.98
IntCEMlambda_roll=0.12023.0986.61
Ind. CBMTraining paradigm=Independent2023.0986.49
IntCEMlambda_roll=0.12023.0986.46
CEM2023.0986.09
Seq. CBMTraining paradigm=Sequential2023.0985.23
Joint CBMBottleneck activation function=Sigmoid2023.0960.11
Joint CBMBottleneck activation function=Logit2023.0959.88