# Target Excess Risk Estimation on Synthetic linear SCMs Simulation 1: CA shift

Source: [Target Excess Risk Estimation on Synthetic linear SCMs Simulation 1: CA shift](<https://www.sota2.com/research/sota/target-excess-risk-estimation-on-synthetic-linear-scms-simulation-1-ca-shift>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-07-01T06:48:17.966Z

Evaluation of Target Excess Risk Estimation performance on the 'Synthetic linear SCMs Simulation 1: CA shift' dataset, measured using RCA metrics at various coverage levels (e.g., 5%, 10%, 15%).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Target Excess Risk Estimation |
| Dataset (including any stated split) | Synthetic linear SCMs Simulation 1: CA shift |
| Metric | RCA (5% Coverage) |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [RCA (5% Coverage)](<https://www.sota2.com/research/sota/target-excess-risk-estimation-on-synthetic-linear-scms-simulation-1-ca-shift.md?metric=RCA%20(5%25%20Coverage)>): Higher is better; unit: SCALAR.

- [RCA (10% Coverage)](<https://www.sota2.com/research/sota/target-excess-risk-estimation-on-synthetic-linear-scms-simulation-1-ca-shift.md?metric=RCA%20(10%25%20Coverage)>): Higher is better; unit: SCALAR.

- [RCA (15% Coverage)](<https://www.sota2.com/research/sota/target-excess-risk-estimation-on-synthetic-linear-scms-simulation-1-ca-shift.md?metric=RCA%20(15%25%20Coverage)>): Higher is better; unit: SCALAR.

## Recorded results

| Method | RCA (5% Coverage) | Result date | Report paper |
| --- | --- | --- | --- |
| OLS-Tar | 1000 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| FT-CIP-Tar | 148 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| CIP | 147 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| OLS-Pool | 145 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| groupDRO | 139 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| V-REx | 111 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| IRM | 63.1 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| FT-CIP | 54.6 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| OLS-Src | 53.6 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| DIP | 24.9 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| FT-OLS-Src-L1 | 1.14 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| FT-OLS-Src-L2 | 1.07 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| MASFT | 0.43 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| FT-DIP | 0.28 | Not recorded | 68fa5dea1e209131ce9ddc53 |
| OLS-Tar-MoreData | 0.17 | Not recorded | 68fa5dea1e209131ce9ddc53 |

### OLS-Tar

RCA (5% Coverage): 1000. Result ID: 6a44b81373d097d845bdb70a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FT-CIP-Tar

RCA (5% Coverage): 148. Result ID: 6a44b81373d097d845bdb706.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

Recorded evaluation configuration: {"incorporates unlabeled target data":"true"}. This record does not assert independent reproduction.

### CIP

RCA (5% Coverage): 147. Result ID: 6a44b81373d097d845bdb700.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OLS-Pool

RCA (5% Coverage): 145. Result ID: 6a44b81373d097d845bdb6fe.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67d21e209131cea18b07.md>)

[Implementation](<https://github.com/facebookresearch/DomainBed>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### groupDRO

RCA (5% Coverage): 139. Result ID: 6a44b81373d097d845bdb701.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67561e209131cea159c7.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### V-REx

RCA (5% Coverage): 111. Result ID: 6a44b81373d097d845bdb703.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69531e209131cea2190f.md>)

[Implementation](<https://anonymous.4open.science/r/12747e81-8505-43cb-b54e-e75e2344a397/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### IRM

RCA (5% Coverage): 63.1. Result ID: 6a44b81373d097d845bdb702.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa673c1e209131cea15133.md>)

[Implementation](<https://github.com/facebookresearch/InvariantRiskMinimization>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FT-CIP

RCA (5% Coverage): 54.6. Result ID: 6a44b81373d097d845bdb705.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OLS-Src

RCA (5% Coverage): 53.6. Result ID: 6a44b81373d097d845bdb6fd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DIP

RCA (5% Coverage): 24.9. Result ID: 6a44b81373d097d845bdb6ff.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FT-OLS-Src-L1

RCA (5% Coverage): 1.14. Result ID: 6a44b81373d097d845bdb707.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

Recorded evaluation configuration: {"constraint":"l1"}. This record does not assert independent reproduction.

### FT-OLS-Src-L2

RCA (5% Coverage): 1.07. Result ID: 6a44b81373d097d845bdb708.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

Recorded evaluation configuration: {"constraint":"l2"}. This record does not assert independent reproduction.

### MASFT

RCA (5% Coverage): 0.43. Result ID: 6a44b81373d097d845bdb709.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FT-DIP

RCA (5% Coverage): 0.28. Result ID: 6a44b81373d097d845bdb704.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OLS-Tar-MoreData

RCA (5% Coverage): 0.17. Result ID: 6a44b81373d097d845bdb70b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dea1e209131ce9ddc53.md>)

Recorded evaluation configuration: {"dataset size":"matched to theoretical bound"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
