List your company
ResearchFormerly WizWand

Task Predictive Performance on CUB Incomp (test)

96.52Accuracy/AUCIntCEM
37.739252.999668.2683.5204Sep 29, 2023
Updated 8mo ago

Evaluation results

MethodLinks
IntCEMFraction of concepts intervened=100%, Intervention Policy=Random2023.0996.52
IntCEMFraction of concepts intervened=100%, Intervention Policy=Learnt Policy ψ2023.0996.52
IntCEMFraction of concepts intervened=75%, Intervention Policy=Learnt Policy ψ2023.0994.96
IntCEMFraction of concepts intervened=75%, Intervention Policy=Random2023.0991.74
IntCEMFraction of concepts intervened=50%, Intervention Policy=Learnt Policy ψ2023.0990.69
IntCEMFraction of concepts intervened=50%, Intervention Policy=Random2023.0985.86
IntCEMFraction of concepts intervened=25%, Intervention Policy=Learnt Policy ψ2023.0981.71
IntCEMFraction of concepts intervened=25%, Intervention Policy=Random2023.0978.34
CEM2023.0975.52
IntCEMlambda_roll=12023.0974.94
IntCEMlambda_roll=0.12023.0974.66
IntCEMlambda_roll=52023.0970.39
Joint CBMBottleneck activation function=Logit2023.0968.42
Joint CBMBottleneck activation function=Sigmoid2023.0959.73
Ind. CBMTraining paradigm=Independent2023.0944.82
Seq. CBMTraining paradigm=Sequential2023.0940