Ripple effect magnitude prediction (ℓ2 logit shift) on Curated ripple-effect corpus 1.0 (test)
0.918Spearman Correlation (ρs)CLARE
Evaluation Results
| Method | Links | |
|---|---|---|
| CLAREModel=GPT2-XL, Editing Technique=PRUNE2026.03 | 0.918 | |
| CLAREModel=GPT-J, Editing Technique=PRUNE2026.03 | 0.917 | |
| CLAREModel=GPT2-XL, Editing Technique=MEMIT2026.03 | 0.915 | |
| CLAREModel=GPT-J, Editing Technique=MEMIT2026.03 | 0.913 | |
| CLAREModel=GPT2-XL, Editing Technique=RECT2026.03 | 0.911 | |
| CLAREModel=GPT2-XL, Editing Technique=ROME2026.03 | 0.909 | |
| CLAREModel=GPT-J, Editing Technique=RECT2026.03 | 0.878 | |
| CLAREModel=Llama3, Editing Technique=AlphaEdit2026.03 | 0.876 | |
| CLAREModel=GPT-J, Editing Technique=AlphaEdit2026.03 | 0.875 | |
| CLAREModel=Llama3, Editing Technique=PRUNE2026.03 | 0.871 | |
| CLAREModel=Llama3, Editing Technique=RECT2026.03 | 0.861 | |
| CLAREModel=GPT-J, Editing Technique=ROME2026.03 | 0.857 | |
| CLAREModel=GPT2-XL, Editing Technique=AlphaEdit2026.03 | 0.854 | |
| CLAREModel=Llama3, Editing Technique=MEMIT2026.03 | 0.848 | |
| CLAREModel=Llama3, Editing Technique=ROME2026.03 | 0.801 | |
| GradSimModel=GPT-J, Editing Technique=PRUNE2026.03 | 0.691 | |
| GradSimModel=GPT-J, Editing Technique=MEMIT2026.03 | 0.677 | |
| GradSimModel=GPT-J, Editing Technique=AlphaEdit2026.03 | 0.663 | |
| GradSimModel=GPT-J, Editing Technique=RECT2026.03 | 0.646 | |
| GradSimModel=GPT-J, Editing Technique=ROME2026.03 | 0.634 | |
| GradSimModel=GPT2-XL, Editing Technique=PRUNE2026.03 | 0.561 | |
| GradSimModel=GPT2-XL, Editing Technique=ROME2026.03 | 0.558 | |
| GradSimModel=GPT2-XL, Editing Technique=AlphaEdit2026.03 | 0.554 | |
| GradSimModel=GPT2-XL, Editing Technique=RECT2026.03 | 0.548 | |
| GradSimModel=GPT2-XL, Editing Technique=MEMIT2026.03 | 0.543 | |
| GradSimModel=Llama3, Editing Technique=RECT2026.03 | 0.468 | |
| GradSimModel=Llama3, Editing Technique=PRUNE2026.03 | 0.46 | |
| GradSimModel=Llama3, Editing Technique=MEMIT2026.03 | 0.442 | |
| GradSimModel=Llama3, Editing Technique=AlphaEdit2026.03 | 0.442 | |
| GradSimModel=Llama3, Editing Technique=ROME2026.03 | 0.389 |