# Counterfactual Error Estimation on Twins (in-sample)

Source: [Counterfactual Error Estimation on Twins (in-sample)](<https://www.sota2.com/research/sota/counterfactual-error-estimation-on-twins-in-sample>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:24:23.674Z

Evaluation of causal inference models using the in-sample split of the Twins dataset, specifically measuring Counterfactual error estimation performance using AUC.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Counterfactual Error Estimation |
| Dataset (including any stated split) | Twins (in-sample) |
| Metric | AUC |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 13 of 13 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUC](<https://www.sota2.com/research/sota/counterfactual-error-estimation-on-twins-in-sample.md?metric=AUC>): Higher is better; unit: SCALAR.

## Recorded results

| Method | AUC | Result date | Report paper |
| --- | --- | --- | --- |
| CIB | 0.87 | Not recorded | 68fa65e21e209131cea0d2da |
| SITE | 0.862 | Not recorded | 68fa65e21e209131cea0d2da |
| CFR-M | 0.852 | Not recorded | 68fa65e21e209131cea0d2da |
| CFR-W | 0.85 | Not recorded | 68fa65e21e209131cea0d2da |
| TARNET | 0.849 | Not recorded | 68fa65e21e209131cea0d2da |
| SITE-W | 0.849 | Not recorded | 68fa65e21e209131cea0d2da |
| HSIC-NNM | 0.762 | Not recorded | 68fa65e21e209131cea0d2da |
| SITE-M | 0.71 | Not recorded | 68fa65e21e209131cea0d2da |
| BNN | 0.69 | Not recorded | 68fa65e21e209131cea0d2da |
| OSL/LR1 | 0.66 | Not recorded | 68fa65e21e209131cea0d2da |
| OSL/LR2 | 0.66 | Not recorded | 68fa65e21e209131cea0d2da |
| k-NN | 0.609 | Not recorded | 68fa65e21e209131cea0d2da |
| PSM | 0.5 | Not recorded | 68fa65e21e209131cea0d2da |

### CIB

AUC: 0.87. Result ID: 698cd1738b517eb4331cf3ec.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### SITE

AUC: 0.862. Result ID: 698cd1738b517eb4331cf3eb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### CFR-M

AUC: 0.852. Result ID: 698cd1738b517eb4331cf3e7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63541e209131ce9fe45c.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### CFR-W

AUC: 0.85. Result ID: 698cd1738b517eb4331cf3e8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63541e209131ce9fe45c.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### TARNET

AUC: 0.849. Result ID: 698cd1738b517eb4331cf3e6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63541e209131ce9fe45c.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### SITE-W

AUC: 0.849. Result ID: 698cd1738b517eb4331cf3ea.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### HSIC-NNM

AUC: 0.762. Result ID: 698cd1738b517eb4331cf3e2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### SITE-M

AUC: 0.71. Result ID: 698cd1738b517eb4331cf3e9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### BNN

AUC: 0.69. Result ID: 698cd1738b517eb4331cf3e5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64671e209131cea046c1.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### OSL/LR1

AUC: 0.66. Result ID: 698cd1738b517eb4331cf3e0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### OSL/LR2

AUC: 0.66. Result ID: 698cd1738b517eb4331cf3e1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### k-NN

AUC: 0.609. Result ID: 698cd1738b517eb4331cf3e4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

### PSM

AUC: 0.5. Result ID: 698cd1738b517eb4331cf3e3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65e21e209131cea0d2da.md>)

Recorded evaluation configuration: {"Evaluation":"in-sample","Repeats":10}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
