# Counterfactual error estimation on Twins (out-sample)

Source: [Counterfactual error estimation on Twins (out-sample)](<https://www.sota2.com/research/sota/counterfactual-error-estimation-on-twins-out-sample>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:24:23.613Z

Evaluation of causal inference models using the out-of-sample split of the Twins dataset, specifically measuring Counterfactual error estimation performance using AUC.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Counterfactual error estimation |
| Dataset (including any stated split) | Twins (out-sample) |
| Metric | AUC |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 13 of 13 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUC](<https://www.sota2.com/research/sota/counterfactual-error-estimation-on-twins-out-sample.md?metric=AUC>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AUC | Result date | Report paper |
| --- | --- | --- | --- |
| CIB | 86.1 | Not recorded | 68fa65e21e209131cea0d2da |
| SITE | 85.3 | Not recorded | 68fa65e21e209131cea0d2da |
| CFR-W | 84.2 | Not recorded | 68fa65e21e209131cea0d2da |
| TARNET | 84 | Not recorded | 68fa65e21e209131cea0d2da |
| CFR-M | 84 | Not recorded | 68fa65e21e209131cea0d2da |
| SITE-W | 76.2 | Not recorded | 68fa65e21e209131cea0d2da |
| SITE-M | 70.5 | Not recorded | 68fa65e21e209131cea0d2da |
| BNN | 67.6 | Not recorded | 68fa65e21e209131cea0d2da |
| PSM | 50.6 | Not recorded | 68fa65e21e209131cea0d2da |
| HSIC-NNM | 50.1 | Not recorded | 68fa65e21e209131cea0d2da |
| OSL/LR1 | 50 | Not recorded | 68fa65e21e209131cea0d2da |
| OSL/LR2 | 50 | Not recorded | 68fa65e21e209131cea0d2da |
| k-NN | 49.2 | Not recorded | 68fa65e21e209131cea0d2da |

### CIB

AUC: 86.1. Result ID: 698cd1738b517eb4331cf39f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SITE

AUC: 85.3. Result ID: 698cd1738b517eb4331cf39e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### CFR-W

AUC: 84.2. Result ID: 698cd1738b517eb4331cf39b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63541e209131ce9fe45c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TARNET

AUC: 84. Result ID: 698cd1738b517eb4331cf399.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63541e209131ce9fe45c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### CFR-M

AUC: 84. Result ID: 698cd1738b517eb4331cf39a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63541e209131ce9fe45c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SITE-W

AUC: 76.2. Result ID: 698cd1738b517eb4331cf39d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SITE-M

AUC: 70.5. Result ID: 698cd1738b517eb4331cf39c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BNN

AUC: 67.6. Result ID: 698cd1738b517eb4331cf398.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64671e209131cea046c1.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PSM

AUC: 50.6. Result ID: 698cd1738b517eb4331cf396.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HSIC-NNM

AUC: 50.1. Result ID: 698cd1738b517eb4331cf395.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OSL/LR1

AUC: 50. Result ID: 698cd1738b517eb4331cf393.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OSL/LR2

AUC: 50. Result ID: 698cd1738b517eb4331cf394.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### k-NN

AUC: 49.2. Result ID: 698cd1738b517eb4331cf397.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
