# Continuous Ranked Probability Score (CRPS) Estimation on Lorenz-96 200 samples (test)

Source: [Continuous Ranked Probability Score (CRPS) Estimation on Lorenz-96 200 samples (test)](<https://www.sota2.com/research/sota/continuous-ranked-probability-score-crps-estimation-on-lorenz-96-200-samples-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:38:48.453Z

Evaluation of model performance using the Continuous Ranked Probability Score (CRPS) metric on the Lorenz-96 system (200 samples, test split), focusing on components F, h, c, and b.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Continuous Ranked Probability Score (CRPS) Estimation |
| Dataset (including any stated split) | Lorenz-96 200 samples (test) |
| Metric | CRPS Component F |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 11 of 11 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [CRPS Component F](<https://www.sota2.com/research/sota/continuous-ranked-probability-score-crps-estimation-on-lorenz-96-200-samples-test.md?metric=CRPS%20Component%20F>): Lower is better; unit: SCALAR.

- [CRPS Component h](<https://www.sota2.com/research/sota/continuous-ranked-probability-score-crps-estimation-on-lorenz-96-200-samples-test.md?metric=CRPS%20Component%20h>): Lower is better; unit: SCALAR.

- [CRPS Component c](<https://www.sota2.com/research/sota/continuous-ranked-probability-score-crps-estimation-on-lorenz-96-200-samples-test.md?metric=CRPS%20Component%20c>): Lower is better; unit: SCALAR.

- [CRPS Component b](<https://www.sota2.com/research/sota/continuous-ranked-probability-score-crps-estimation-on-lorenz-96-200-samples-test.md?metric=CRPS%20Component%20b>): Lower is better; unit: SCALAR.

## Recorded results

| Method | CRPS Component F | Result date | Report paper |
| --- | --- | --- | --- |
| EnKI w/ EMBED & EMULATE | 0.36 | Not recorded | 68fa59c31e209131ce9ba1c0 |
| h\_theta w/ EMBED & EMULATE | 0.412 | Not recorded | 68fa59c31e209131ce9ba1c0 |
| Supervised Regression | 0.478 | Not recorded | 68fa59c31e209131ce9ba1c0 |
| NPE-C | 0.593 | Not recorded | 68fa59c31e209131ce9ba1c0 |
| EnKI w/ EMBED & EMULATE | 0.615 | Not recorded | 68fa59c31e209131ce9ba1c0 |
| h\_theta w/ EMBED & EMULATE | 0.698 | Not recorded | 68fa59c31e209131ce9ba1c0 |
| Supervised Regression | 0.707 | Not recorded | 68fa59c31e209131ce9ba1c0 |
| NPE-C | 0.844 | Not recorded | 68fa59c31e209131ce9ba1c0 |
| EnKI w/o Learning | 0.91 | Not recorded | 68fa59c31e209131ce9ba1c0 |
| SNL+ | 1.304 | Not recorded | 68fa59c31e209131ce9ba1c0 |
| SNL+ | 1.399 | Not recorded | 68fa59c31e209131ce9ba1c0 |

### EnKI w/ EMBED & EMULATE

CRPS Component F: 0.36. Result ID: 698ba9027a967eddb770673c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Implementation](<https://github.com/roxie62/Embed-and-Emulate>)

Recorded evaluation configuration: {"n":"1000"}. This record does not assert independent reproduction.

### h\_theta w/ EMBED & EMULATE

CRPS Component F: 0.412. Result ID: 698ba9027a967eddb770673b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Implementation](<https://github.com/roxie62/Embed-and-Emulate>)

Recorded evaluation configuration: {"n":"1000"}. This record does not assert independent reproduction.

### Supervised Regression

CRPS Component F: 0.478. Result ID: 698ba9027a967eddb770673d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62321e209131ce9f8328.md>)

Recorded evaluation configuration: {"n":"1000"}. This record does not assert independent reproduction.

### NPE-C

CRPS Component F: 0.593. Result ID: 698ba9027a967eddb770673e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c61e209131cea0c688.md>)

Recorded evaluation configuration: {"n":"1000"}. This record does not assert independent reproduction.

### EnKI w/ EMBED & EMULATE

CRPS Component F: 0.615. Result ID: 698ba9027a967eddb7706737.

[Reporting paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Implementation](<https://github.com/roxie62/Embed-and-Emulate>)

Recorded evaluation configuration: {"n":"500"}. This record does not assert independent reproduction.

### h\_theta w/ EMBED & EMULATE

CRPS Component F: 0.698. Result ID: 698ba9027a967eddb7706736.

[Reporting paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Implementation](<https://github.com/roxie62/Embed-and-Emulate>)

Recorded evaluation configuration: {"n":"500"}. This record does not assert independent reproduction.

### Supervised Regression

CRPS Component F: 0.707. Result ID: 698ba9027a967eddb7706738.

[Reporting paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62321e209131ce9f8328.md>)

Recorded evaluation configuration: {"n":"500"}. This record does not assert independent reproduction.

### NPE-C

CRPS Component F: 0.844. Result ID: 698ba9027a967eddb7706739.

[Reporting paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c61e209131cea0c688.md>)

Recorded evaluation configuration: {"n":"500"}. This record does not assert independent reproduction.

### EnKI w/o Learning

CRPS Component F: 0.91. Result ID: 698ba9027a967eddb7706735.

[Reporting paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa37301e209131ce8afec3.md>)

Recorded evaluation configuration: {"n":"0"}. This record does not assert independent reproduction.

### SNL+

CRPS Component F: 1.304. Result ID: 698ba9027a967eddb770673f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

Recorded evaluation configuration: {"n":"1000"}. This record does not assert independent reproduction.

### SNL+

CRPS Component F: 1.399. Result ID: 698ba9027a967eddb770673a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa59c31e209131ce9ba1c0.md>)

Recorded evaluation configuration: {"n":"500"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.