Sequential Model Editing on ZsRE
99.74EfficacyAlphaEdit
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AlphaEditModel=Qwen-7B2025.10 | 99.74 | 91.58 | 41.58 | |
| EvoEditModel=Qwen-7B2025.10 | 99.54 | 91.67 | 41.97 | |
| NSEModel=GPT-J2024.10 | 96.87 | 91.33 | 28.66 | |
| EvoEditModel=Llama-3-8B2025.10 | 95.74 | 92.13 | 32.41 | |
| EvoEditModel=Llama-3-3B2025.10 | 94.97 | 89.92 | 29.26 | |
| MEMITModel=GPT-J2024.10 | 94.91 | 90.22 | 27.56 | |
| AlphaEditModel=Llama-3-8B2025.10 | 94.47 | 91.13 | 32.55 | |
| AlphaEditModel=Llama-3-3B2025.10 | 94.44 | 89.87 | 30.09 | |
| GRACEModel=GPT-J2024.10 | 94.33 | 1.59 | 27.63 | |
| SPHEREModel=LLaMA3-8B2025.10 | 90.01 | 84.67 | 45.4 | |
| AlphaEditModel=LLaMA3-8B2025.10 | 86.64 | 81.28 | 28.78 | |
| RECTModel=Llama-3-8B2025.10 | 86.05 | 80.54 | 31.67 | |
| NSEModel=GPT2-XL2024.10 | 83.26 | 75.33 | 26.14 | |
| GRACEModel=GPT2-XL2024.10 | 82.54 | 0.4 | 24.78 | |
| MEMITModel=GPT2-XL2024.10 | 79.17 | 71.44 | 26.12 | |
| GRACEModel=Llama32024.10 | 74.58 | 1.03 | 31.86 | |
| FT-LModel=GPT-J2024.10 | 72.37 | 68.91 | 19.66 | |
| SPHEREModel=Qwen2.5-7B2025.10 | 70.04 | 65.43 | 27.35 | |
| NSEModel=Llama32024.10 | 62.29 | 47.13 | 32.32 | |
| ROMEModel=GPT-J2024.10 | 56.42 | 54.65 | 9.86 | |
| PRUNEModel=Qwen2.5-7B2025.10 | 47.93 | 45.5 | 39.2 | |
| ROMEModel=GPT2-XL2024.10 | 47.5 | 43.56 | 14.27 | |
| AlphaEditModel=Qwen2.5-7B2025.10 | 42.01 | 39.99 | 13.87 | |
| FT-WModel=GPT-J2024.10 | 39.81 | 32.55 | 27.76 | |
| FT-LModel=GPT2-XL2024.10 | 37.11 | 33.3 | 10.36 | |
| Pre-editedModel=Llama32024.10 | 36.99 | 36.34 | 31.89 | |
| Pre-editedModel=LLaMA3-8B2025.10 | 35.42 | 34.17 | 38.02 | |
| Pre-editedModel=Qwen2.5-7B2025.10 | 35.29 | 34.1 | 38.44 | |
| MEMITModel=Llama32024.10 | 34.62 | 31.28 | 18.49 | |
| MEMITModel=Llama-3-8B2025.10 | 34.62 | 31.28 | 18.49 | |
| MEMITModel=Qwen-7B2025.10 | 34.62 | 31.28 | 18.49 | |
| FT-WModel=Llama32024.10 | 32.08 | 31.43 | 14.72 | |
| FT-LModel=Llama32024.10 | 30.48 | 30.22 | 15.49 | |
| FTModel=Llama-3-8B2025.10 | 30.48 | 30.22 | 15.49 | |
| Pre-editedModel=GPT-J2024.10 | 26.32 | 25.79 | 27.42 | |
| FT-WModel=GPT2-XL2024.10 | 24.97 | 22.4 | 12.73 | |
| PRUNEModel=Llama-3-8B2025.10 | 24.77 | 23.87 | 20.69 | |
| Pre-editedModel=GPT2-XL2024.10 | 22.19 | 31.3 | 24.15 | |
| ROMEModel=Qwen-7B2025.10 | 18.93 | 17.2 | 7.56 | |
| FTModel=LLaMA3-8B2025.10 | 15.27 | 14.78 | 5.06 | |
| PRUNEModel=LLaMA3-8B2025.10 | 10.35 | 10.08 | 9.55 | |
| FTModel=Qwen2.5-7B2025.10 | 4.97 | 4.58 | 4.01 | |
| ROMEModel=Llama-3-3B2025.10 | 2.25 | 2.03 | 0.05 | |
| ROMEModel=Llama32024.10 | 2.01 | 1.8 | 0.69 | |
| ROMEModel=Llama-3-8B2025.10 | 2.01 | 1.8 | 0.69 | |
| InstructEditModel=Llama-3-8B2025.10 | 1.58 | 1.36 | 1.01 | |
| MENDModel=Llama32024.10 | 0.91 | 1.09 | 0.53 | |
| MENDModel=Llama-3-8B2025.10 | 0.91 | 1.09 | 0.53 | |
| RECTModel=Qwen2.5-7B2025.10 | 0.73 | 0.75 | 0.05 | |
| MENDModel=GPT-J2024.10 | 0.71 | 0.71 | 0.52 | |
| MEMITModel=Qwen2.5-7B2025.10 | 0.13 | 0.12 | 0.04 | |
| RECTModel=LLaMA3-8B2025.10 | 0.01 | 0.01 | 0.04 | |
| MENDModel=GPT2-XL2024.10 | 0 | 0 | 0 | |
| MEMITModel=LLaMA3-8B2025.10 | 0 | 0 | 0.06 | |
| MEMITModel=Llama-3-3B2025.10 | 0 | 0 | 1.59 |