Model Editing on CounterFact (Efficacy, Generalization, Specificity, Edited Retention)
73.06EfficacyAlphaEdit
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AlphaEditBase Model=LLAMA-3-8B2026.04 | 73.06 | 66.43 | 48.54 | 47.4 | |
| HiEditfullBase Model=LLAMA-3-8B2026.04 | 66.53 | 55.65 | 45.7 | 58.2 | |
| HiEditrandBase Model=LLAMA-3-8B2026.04 | 66.4 | 55.48 | 45.51 | 58 | |
| RLEditBase Model=LLAMA-3-8B2026.04 | 66.35 | 55.26 | 44.79 | 57.2 | |
| FTBase Model=LLAMA-3-8B2026.04 | 65.24 | 57.99 | 44.03 | 62.8 | |
| HiEditfullBase Model=GEMMA-2-9B2026.04 | 64.06 | 52.8 | 43.59 | 54 | |
| FTBase Model=GEMMA-2-9B2026.04 | 60.13 | 39.49 | 52.26 | 42.7 | |
| HiEditrandBase Model=GEMMA-2-9B2026.04 | 59.81 | 50 | 47.37 | 50.3 | |
| ROMEBase Model=LLAMA-3-8B2026.04 | 59.26 | 56.45 | 48.52 | 48.3 | |
| RLEditBase Model=GEMMA-2-9B2026.04 | 55.51 | 49.92 | 46.28 | 45.8 | |
| AlphaEditBase Model=GEMMA-2-9B2026.04 | 38.17 | 38.83 | 66.51 | 34 | |
| PRUNEBase Model=GEMMA-2-9B2026.04 | 32.41 | 29.78 | 65.1 | 29.8 | |
| HiEdit_fullBase Model=Llama-3-8B, Metric Type=Top-1 accuracy2026.04 | 31.66 | 22.41 | 10.8 | 23.05 | |
| MEMITBase Model=GEMMA-2-9B2026.04 | 31.51 | 28.78 | 65.58 | 30.1 | |
| HiEdit_randBase Model=Llama-3-8B, Metric Type=Top-1 accuracy2026.04 | 31.45 | 22.35 | 10.96 | 22.75 | |
| RECTBase Model=GEMMA-2-9B2026.04 | 30.72 | 28.34 | 66.08 | 30 | |
| DAFNetBase Model=LLAMA-3-8B2026.04 | 29.56 | 31.55 | 68.38 | 33.6 | |
| RLEditBase Model=Llama-3-8B, Metric Type=Top-1 accuracy2026.04 | 27.93 | 20.58 | 10.83 | 21 | |
| MENDBase Model=GEMMA-2-9B2026.04 | 27.28 | 28.54 | 70.2 | 27.7 | |
| MEMITBase Model=LLAMA-3-8B2026.04 | 18.61 | 16.94 | 16.93 | 16.2 | |
| AlphaEditBase Model=Llama-3-8B, Metric Type=Top-1 accuracy2026.04 | 11.64 | 4.87 | 1.49 | 1.6 | |
| MALMENBase Model=GEMMA-2-9B2026.04 | 10.46 | 13.12 | 86.94 | 11.4 | |
| DAFNetBase Model=GEMMA-2-9B2026.04 | 10.23 | 12.74 | 86.6 | 13.5 | |
| Pre-editedBase Model=GEMMA-2-9B2026.04 | 8.23 | 10.8 | 88.72 | 10.4 | |
| MENDBase Model=LLAMA-3-8B2026.04 | 7.69 | 13.4 | 7.45 | 10.5 | |
| Pre-editedBase Model=LLAMA-3-8B2026.04 | 7.2 | 9.1 | 89.77 | 8.7 | |
| ROMEBase Model=Llama-3-8B, Metric Type=Top-1 accuracy2026.04 | 1.78 | 1.8 | 1.17 | 0.9 | |
| Pre-editedBase Model=Llama-3-8B, Metric Type=Top-1 accuracy2026.04 | 1.01 | 1.01 | 21.74 | 1.35 | |
| FTBase Model=Llama-3-8B, Metric Type=Top-1 accuracy2026.04 | 0.29 | 0.06 | 0 | 0.03 | |
| PRUNEBase Model=LLAMA-3-8B2026.04 | 0 | 0 | 0 | 0 | |
| RECTBase Model=LLAMA-3-8B2026.04 | 0 | 0 | 0 | 0 | |
| MALMENBase Model=LLAMA-3-8B2026.04 | 0 | 0 | 0 | 0 | |
| ROMEBase Model=GEMMA-2-9B2026.04 | 0 | 0 | 0 | 0 |