# Ripple effect magnitude prediction (\|Δ log P(y)\|) on Curated ripple-effect corpus 1.0 (test)

Source: [Ripple effect magnitude prediction (\|Δ log P(y)\|) on Curated ripple-effect corpus 1.0 (test)](<https://www.sota2.com/research/sota/ripple-effect-magnitude-prediction-log-p-y-on-curated-ripple-effect-corpus-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-23T11:04:17.689Z

Evaluation of model performance on predicting the ripple effect magnitude using the test split of the Curated ripple-effect corpus 1.0, measured by Spearman correlation (ρs).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Ripple effect magnitude prediction (\|Δ log P(y)\|) |
| Dataset (including any stated split) | Curated ripple-effect corpus 1.0 (test) |
| Metric | Spearman Correlation (ρs) |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 30 of 30 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Spearman Correlation (ρs)](<https://www.sota2.com/research/sota/ripple-effect-magnitude-prediction-log-p-y-on-curated-ripple-effect-corpus-1-0-test.md?metric=Spearman%20Correlation%20(%CF%81s)>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Spearman Correlation (ρs) | Result date | Report paper |
| --- | --- | --- | --- |
| CLARE | 0.854 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.838 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.822 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.805 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.805 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.798 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.797 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.785 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.774 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.772 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.77 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.753 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.747 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.706 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| CLARE | 0.697 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.597 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.582 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.558 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.55 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.549 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.547 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.545 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.544 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.531 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.509 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.471 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.432 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.428 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.339 | Not recorded | 69c0c9020636e5bf4afc3b5a |
| GradSim | 0.308 | Not recorded | 69c0c9020636e5bf4afc3b5a |

### CLARE

Spearman Correlation (ρs): 0.854. Result ID: 69c11e2547f34ce924a96dab.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"GPT-J","Editing Technique":"PRUNE"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.838. Result ID: 69c11e2547f34ce924a96da5.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"GPT-J","Editing Technique":"MEMIT"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.822. Result ID: 69c11e2547f34ce924a96db5.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"GPT2-XL","Editing Technique":"PRUNE"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.805. Result ID: 69c11e2547f34ce924a96da7.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"GPT-J","Editing Technique":"RECT"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.805. Result ID: 69c11e2547f34ce924a96dad.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"GPT-J","Editing Technique":"AlphaEdit"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.798. Result ID: 69c11e2547f34ce924a96dbf.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"Llama3","Editing Technique":"PRUNE"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.797. Result ID: 69c11e2547f34ce924a96da9.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"GPT-J","Editing Technique":"ROME"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.785. Result ID: 69c11e2547f34ce924a96db3.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"GPT2-XL","Editing Technique":"ROME"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.774. Result ID: 69c11e2547f34ce924a96db1.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"GPT2-XL","Editing Technique":"RECT"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.772. Result ID: 69c11e2547f34ce924a96db9.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"Llama3","Editing Technique":"MEMIT"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.77. Result ID: 69c11e2547f34ce924a96daf.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"GPT2-XL","Editing Technique":"MEMIT"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.753. Result ID: 69c11e2547f34ce924a96db7.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"GPT2-XL","Editing Technique":"AlphaEdit"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.747. Result ID: 69c11e2547f34ce924a96dbb.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"Llama3","Editing Technique":"RECT"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.706. Result ID: 69c11e2547f34ce924a96dbd.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"Llama3","Editing Technique":"ROME"}. This record does not assert independent reproduction.

### CLARE

Spearman Correlation (ρs): 0.697. Result ID: 69c11e2547f34ce924a96dc1.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

Recorded evaluation configuration: {"Model":"Llama3","Editing Technique":"AlphaEdit"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.597. Result ID: 69c11e2547f34ce924a96daa.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"GPT-J","Editing Technique":"PRUNE"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.582. Result ID: 69c11e2547f34ce924a96da4.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"GPT-J","Editing Technique":"MEMIT"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.558. Result ID: 69c11e2547f34ce924a96db4.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"GPT2-XL","Editing Technique":"PRUNE"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.55. Result ID: 69c11e2547f34ce924a96db6.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"GPT2-XL","Editing Technique":"AlphaEdit"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.549. Result ID: 69c11e2547f34ce924a96da6.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"GPT-J","Editing Technique":"RECT"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.547. Result ID: 69c11e2547f34ce924a96dac.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"GPT-J","Editing Technique":"AlphaEdit"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.545. Result ID: 69c11e2547f34ce924a96dae.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"GPT2-XL","Editing Technique":"MEMIT"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.544. Result ID: 69c11e2547f34ce924a96db2.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"GPT2-XL","Editing Technique":"ROME"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.531. Result ID: 69c11e2547f34ce924a96db0.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"GPT2-XL","Editing Technique":"RECT"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.509. Result ID: 69c11e2547f34ce924a96da8.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"GPT-J","Editing Technique":"ROME"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.471. Result ID: 69c11e2547f34ce924a96db8.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"Llama3","Editing Technique":"MEMIT"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.432. Result ID: 69c11e2547f34ce924a96dba.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"Llama3","Editing Technique":"RECT"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.428. Result ID: 69c11e2547f34ce924a96dbe.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"Llama3","Editing Technique":"PRUNE"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.339. Result ID: 69c11e2547f34ce924a96dc0.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"Llama3","Editing Technique":"AlphaEdit"}. This record does not assert independent reproduction.

### GradSim

Spearman Correlation (ρs): 0.308. Result ID: 69c11e2547f34ce924a96dbc.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c9020636e5bf4afc3b5a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1b1e209131cea8132b.md>)

Recorded evaluation configuration: {"Model":"Llama3","Editing Technique":"ROME"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
