# Counterfactual Explanations on Credit (test)

Source: [Counterfactual Explanations on Credit (test)](<https://www.sota2.com/research/sota/counterfactual-explanations-on-credit-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:46:52.102Z

Evaluation of counterfactual explanation methods on the test split of the Credit dataset, measured by metrics including IM1, Implausibility, Robustness Ratio, and Validity.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Counterfactual Explanations |
| Dataset (including any stated split) | Credit (test) |
| Metric | IM1 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [IM1](<https://www.sota2.com/research/sota/counterfactual-explanations-on-credit-test.md?metric=IM1>): Higher is better; unit: SCALAR.

- [Implausibility](<https://www.sota2.com/research/sota/counterfactual-explanations-on-credit-test.md?metric=Implausibility>): Lower is better; unit: SCALAR.

- [Robustness Ratio (1e-3)](<https://www.sota2.com/research/sota/counterfactual-explanations-on-credit-test.md?metric=Robustness%20Ratio%20(1e-3)>): Higher is better; unit: SCALAR.

- [Validity](<https://www.sota2.com/research/sota/counterfactual-explanations-on-credit-test.md?metric=Validity>): Higher is better; unit: PERCENT.

## Recorded results

| Method | IM1 | Result date | Report paper |
| --- | --- | --- | --- |
| BayesCF | 1.0767 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| BayesCF | 1.0767 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| Wachter | 1.0429 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| Wachter | 1.0423 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| ROAR | 1.0285 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| ROAR | 1.0275 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| Schut | 0.9251 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| Schut | 0.9251 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| Schut | 0.9042 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| Schut | 0.9042 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| BayesCF | 0.8311 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| BayesCF | 0.8311 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| PSCE | 0.7383 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| PSCE | 0.7383 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| PSCE | 0.6561 | Not recorded | 6976f4e9a2b28e761d87c0f0 |
| PSCE | 0.6561 | Not recorded | 6976f4e9a2b28e761d87c0f0 |

### BayesCF

IM1: 1.0767. Result ID: 69991f7a5698665ec4866dc8.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

Recorded evaluation configuration: {"Uncertainty Estimation":"MC Dropout"}. This record does not assert independent reproduction.

### BayesCF

IM1: 1.0767. Result ID: 69991f7a5698665ec4866de1.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

Recorded evaluation configuration: {"Inference Method":"MC Dropout"}. This record does not assert independent reproduction.

### Wachter

IM1: 1.0429. Result ID: 69991f7a5698665ec4866dca.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64261e209131cea02e3a.md>)

Recorded evaluation configuration: {"Uncertainty Estimation":"MC Dropout"}. This record does not assert independent reproduction.

### Wachter

IM1: 1.0423. Result ID: 69991f7a5698665ec4866db1.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64261e209131cea02e3a.md>)

Recorded evaluation configuration: {"Backbone":"BNN"}. This record does not assert independent reproduction.

### ROAR

IM1: 1.0285. Result ID: 69991f7a5698665ec4866db2.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27783.md>)

Recorded evaluation configuration: {"Backbone":"BNN"}. This record does not assert independent reproduction.

### ROAR

IM1: 1.0275. Result ID: 69991f7a5698665ec4866dcb.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27783.md>)

Recorded evaluation configuration: {"Uncertainty Estimation":"MC Dropout"}. This record does not assert independent reproduction.

### Schut

IM1: 0.9251. Result ID: 69991f7a5698665ec4866dc9.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22aa4.md>)

Recorded evaluation configuration: {"Uncertainty Estimation":"MC Dropout"}. This record does not assert independent reproduction.

### Schut

IM1: 0.9251. Result ID: 69991f7a5698665ec4866de2.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22aa4.md>)

Recorded evaluation configuration: {"Inference Method":"MC Dropout"}. This record does not assert independent reproduction.

### Schut

IM1: 0.9042. Result ID: 69991f7a5698665ec4866db0.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22aa4.md>)

Recorded evaluation configuration: {"Backbone":"BNN"}. This record does not assert independent reproduction.

### Schut

IM1: 0.9042. Result ID: 69991f7a5698665ec4866df1.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22aa4.md>)

Recorded evaluation configuration: {"Model":"BNN"}. This record does not assert independent reproduction.

### BayesCF

IM1: 0.8311. Result ID: 69991f7a5698665ec4866daf.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

Recorded evaluation configuration: {"Backbone":"BNN"}. This record does not assert independent reproduction.

### BayesCF

IM1: 0.8311. Result ID: 69991f7a5698665ec4866df0.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

Recorded evaluation configuration: {"Model":"BNN"}. This record does not assert independent reproduction.

### PSCE

IM1: 0.7383. Result ID: 69991f7a5698665ec4866dc7.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

Recorded evaluation configuration: {"Uncertainty Estimation":"MC Dropout"}. This record does not assert independent reproduction.

### PSCE

IM1: 0.7383. Result ID: 69991f7a5698665ec4866de0.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

Recorded evaluation configuration: {"Inference Method":"MC Dropout"}. This record does not assert independent reproduction.

### PSCE

IM1: 0.6561. Result ID: 69991f7a5698665ec4866dae.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

Recorded evaluation configuration: {"Backbone":"BNN"}. This record does not assert independent reproduction.

### PSCE

IM1: 0.6561. Result ID: 69991f7a5698665ec4866def.

[Reporting paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6976f4e9a2b28e761d87c0f0.md>)

Recorded evaluation configuration: {"Model":"BNN"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
