SCM
Benchmarks
TaskDatasetSOTA resultTrendResults
SCM dataset linear SCMs (test)
9.82W2
10
SCM20d
0.007Epsilon
9
SCM marginal shift
1ROC AUC
9
SCM spurious shift (test)
0.733ROC AUC
9
SCM RFF Prior
0.021-WD
8
SCM NN Prior
0.0241-WD
8
SCM Tree Prior
0.0261-WD
8
scm20d
1.73ERT (%)
7
scm1d
2.99ERT
7
scm20d
10Standardized Energy Distance
7
scm1d
10Standardized energy distance
7
SCM20d
79.944Running time (s)
5
SCM20d
275.828Model size (MB)
5
SCM1d
660.584Model Size (MB)
5
scm20d
99.3Coverage (%)
4
scm20d
90.4Coverage
4
scm20d
4.25Normalized Volume
4
scm1d
4.43Normalized Volume
4
scm20d
3.45Normalized Volume
4
SCM
77.7Accuracy
3
SCM battery
28Infeasible Rate
1
SCM
88.4Answer Accuracy
1