Ripple effect magnitude prediction (|Δ log P(y)|) on Curated ripple-effect corpus 1.0 (test)
0.854Spearman Correlation (ρs)CLARE
Evaluation Results
| Method | Links | |
|---|---|---|
| CLAREModel=GPT-J, Editing Technique=PRUNE2026.03 | 0.854 | |
| CLAREModel=GPT-J, Editing Technique=MEMIT2026.03 | 0.838 | |
| CLAREModel=GPT2-XL, Editing Technique=PRUNE2026.03 | 0.822 | |
| CLAREModel=GPT-J, Editing Technique=RECT2026.03 | 0.805 | |
| CLAREModel=GPT-J, Editing Technique=AlphaEdit2026.03 | 0.805 | |
| CLAREModel=Llama3, Editing Technique=PRUNE2026.03 | 0.798 | |
| CLAREModel=GPT-J, Editing Technique=ROME2026.03 | 0.797 | |
| CLAREModel=GPT2-XL, Editing Technique=ROME2026.03 | 0.785 | |
| CLAREModel=GPT2-XL, Editing Technique=RECT2026.03 | 0.774 | |
| CLAREModel=Llama3, Editing Technique=MEMIT2026.03 | 0.772 | |
| CLAREModel=GPT2-XL, Editing Technique=MEMIT2026.03 | 0.77 | |
| CLAREModel=GPT2-XL, Editing Technique=AlphaEdit2026.03 | 0.753 | |
| CLAREModel=Llama3, Editing Technique=RECT2026.03 | 0.747 | |
| CLAREModel=Llama3, Editing Technique=ROME2026.03 | 0.706 | |
| CLAREModel=Llama3, Editing Technique=AlphaEdit2026.03 | 0.697 | |
| GradSimModel=GPT-J, Editing Technique=PRUNE2026.03 | 0.597 | |
| GradSimModel=GPT-J, Editing Technique=MEMIT2026.03 | 0.582 | |
| GradSimModel=GPT2-XL, Editing Technique=PRUNE2026.03 | 0.558 | |
| GradSimModel=GPT2-XL, Editing Technique=AlphaEdit2026.03 | 0.55 | |
| GradSimModel=GPT-J, Editing Technique=RECT2026.03 | 0.549 | |
| GradSimModel=GPT-J, Editing Technique=AlphaEdit2026.03 | 0.547 | |
| GradSimModel=GPT2-XL, Editing Technique=MEMIT2026.03 | 0.545 | |
| GradSimModel=GPT2-XL, Editing Technique=ROME2026.03 | 0.544 | |
| GradSimModel=GPT2-XL, Editing Technique=RECT2026.03 | 0.531 | |
| GradSimModel=GPT-J, Editing Technique=ROME2026.03 | 0.509 | |
| GradSimModel=Llama3, Editing Technique=MEMIT2026.03 | 0.471 | |
| GradSimModel=Llama3, Editing Technique=RECT2026.03 | 0.432 | |
| GradSimModel=Llama3, Editing Technique=PRUNE2026.03 | 0.428 | |
| GradSimModel=Llama3, Editing Technique=AlphaEdit2026.03 | 0.339 | |
| GradSimModel=Llama3, Editing Technique=ROME2026.03 | 0.308 |