# Counterfactual Sampling on NAPKIN Semi-Markovian continuous (test)

Source: [Counterfactual Sampling on NAPKIN Semi-Markovian continuous (test)](<https://www.sota2.com/research/sota/counterfactual-sampling-on-napkin-semi-markovian-continuous-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:41:51.399Z

Evaluation of Counterfactual Sampling models on the test split of the NAPKIN Semi-Markovian continuous dataset, measured using ESP and FR metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Counterfactual Sampling |
| Dataset (including any stated split) | NAPKIN Semi-Markovian continuous (test) |
| Metric | ESP |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ESP](<https://www.sota2.com/research/sota/counterfactual-sampling-on-napkin-semi-markovian-continuous-test.md?metric=ESP>): Lower is better; unit: SCALAR.

- [FR](<https://www.sota2.com/research/sota/counterfactual-sampling-on-napkin-semi-markovian-continuous-test.md?metric=FR>): Higher is better; unit: SCALAR.

## Recorded results

| Method | ESP | Result date | Report paper |
| --- | --- | --- | --- |
| RS | 0 | Not recorded | 68fa76eb1e209131cea6ff0d |
| CEIS | 0 | Not recorded | 68fa76eb1e209131cea6ff0d |
| NIS | 0 | Not recorded | 68fa76eb1e209131cea6ff0d |
| RS | 0 | Not recorded | 68fa76eb1e209131cea6ff0d |
| CEIS | 0 | Not recorded | 68fa76eb1e209131cea6ff0d |
| NIS | 0 | Not recorded | 68fa76eb1e209131cea6ff0d |
| RS | 0.006 | Not recorded | 68fa76eb1e209131cea6ff0d |
| NIS | 0.007 | Not recorded | 68fa76eb1e209131cea6ff0d |
| EXOM\[GMM\] | 0.009 | Not recorded | 68fa76eb1e209131cea6ff0d |
| EXOM\[GMM\] | 0.011 | Not recorded | 68fa76eb1e209131cea6ff0d |
| CEIS | 0.017 | Not recorded | 68fa76eb1e209131cea6ff0d |
| EXOM\[GMM\] | 0.039 | Not recorded | 68fa76eb1e209131cea6ff0d |
| EXOM\[MAF\] | 0.306 | Not recorded | 68fa76eb1e209131cea6ff0d |
| EXOM\[MAF\] | 0.397 | Not recorded | 68fa76eb1e209131cea6ff0d |
| EXOM\[MAF\] | 0.482 | Not recorded | 68fa76eb1e209131cea6ff0d |

### RS

ESP: 0. Result ID: 699466f53a6c3148491d002c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

Recorded evaluation configuration: {"\|s\|":"3"}. This record does not assert independent reproduction.

### CEIS

ESP: 0. Result ID: 699466f53a6c3148491d002d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

Recorded evaluation configuration: {"\|s\|":"3"}. This record does not assert independent reproduction.

### NIS

ESP: 0. Result ID: 699466f53a6c3148491d002e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66401e209131cea0f2e5.md>)

Recorded evaluation configuration: {"\|s\|":"3"}. This record does not assert independent reproduction.

### RS

ESP: 0. Result ID: 699466f53a6c3148491d0031.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

Recorded evaluation configuration: {"\|s\|":"5"}. This record does not assert independent reproduction.

### CEIS

ESP: 0. Result ID: 699466f53a6c3148491d0032.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

Recorded evaluation configuration: {"\|s\|":"5"}. This record does not assert independent reproduction.

### NIS

ESP: 0. Result ID: 699466f53a6c3148491d0033.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66401e209131cea0f2e5.md>)

Recorded evaluation configuration: {"\|s\|":"5"}. This record does not assert independent reproduction.

### RS

ESP: 0.006. Result ID: 699466f53a6c3148491d0027.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

Recorded evaluation configuration: {"\|s\|":"1"}. This record does not assert independent reproduction.

### NIS

ESP: 0.007. Result ID: 699466f53a6c3148491d0029.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66401e209131cea0f2e5.md>)

Recorded evaluation configuration: {"\|s\|":"1"}. This record does not assert independent reproduction.

### EXOM\[GMM\]

ESP: 0.009. Result ID: 699466f53a6c3148491d0034.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Implementation](<https://github.com/cyisk/exom>)

Recorded evaluation configuration: {"\|s\|":"5"}. This record does not assert independent reproduction.

### EXOM\[GMM\]

ESP: 0.011. Result ID: 699466f53a6c3148491d002f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Implementation](<https://github.com/cyisk/exom>)

Recorded evaluation configuration: {"\|s\|":"3"}. This record does not assert independent reproduction.

### CEIS

ESP: 0.017. Result ID: 699466f53a6c3148491d0028.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

Recorded evaluation configuration: {"\|s\|":"1"}. This record does not assert independent reproduction.

### EXOM\[GMM\]

ESP: 0.039. Result ID: 699466f53a6c3148491d002a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Implementation](<https://github.com/cyisk/exom>)

Recorded evaluation configuration: {"\|s\|":"1"}. This record does not assert independent reproduction.

### EXOM\[MAF\]

ESP: 0.306. Result ID: 699466f53a6c3148491d002b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Implementation](<https://github.com/cyisk/exom>)

Recorded evaluation configuration: {"\|s\|":"1"}. This record does not assert independent reproduction.

### EXOM\[MAF\]

ESP: 0.397. Result ID: 699466f53a6c3148491d0030.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Implementation](<https://github.com/cyisk/exom>)

Recorded evaluation configuration: {"\|s\|":"3"}. This record does not assert independent reproduction.

### EXOM\[MAF\]

ESP: 0.482. Result ID: 699466f53a6c3148491d0035.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76eb1e209131cea6ff0d.md>)

[Implementation](<https://github.com/cyisk/exom>)

Recorded evaluation configuration: {"\|s\|":"5"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
