Model Editing on FEVER 20K edits (test)
99.07EfficacySTABLEEDIT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| STABLEEDITBackbone=Qwen2.5-7B-Instruct2026.05 | 99.07 | 94.87 | 69.61 | |
| STABLEEDITBackbone=Mistral-7B-v0.32026.05 | 98.38 | 96.55 | 83.89 | |
| STABLEEDITBackbone=GPT-J-6B2026.05 | 98.35 | 96.99 | 79.85 | |
| ULTRAEDITBackbone=Qwen2.5-7B-Instruct2026.05 | 97.97 | 93.91 | 68.86 | |
| STABLEEDITBackbone=Llama-3-8B-Instruct2026.05 | 97.89 | 94.47 | 69.24 | |
| ULTRAEDITBackbone=Mistral-7B-v0.32026.05 | 97.87 | 96.09 | 84.29 | |
| ULTRAEDITBackbone=GPT-J-6B2026.05 | 97.45 | 96.37 | 79.72 | |
| RLEDITBackbone=GPT-J-6B2026.05 | 97.29 | 96.01 | 79.86 | |
| RLEDITBackbone=Qwen2.5-7B-Instruct2026.05 | 96.93 | 93.92 | 68.28 | |
| ULTRAEDITBackbone=Llama-3-8B-Instruct2026.05 | 95.39 | 91.93 | 67.14 | |
| MALMENBackbone=Llama-3-8B-Instruct2026.05 | 95.03 | 92.44 | 69.2 | |
| RLEDITBackbone=Mistral-7B-v0.32026.05 | 92.35 | 91.39 | 71.85 | |
| RLEDITBackbone=Llama-3-8B-Instruct2026.05 | 91.38 | 89.93 | 41.98 | |
| MENDBackbone=Qwen2.5-7B-Instruct2026.05 | 76.43 | 77.66 | 40.39 | |
| MENDBackbone=GPT-J-6B2026.05 | 52.8 | 51.44 | 45.42 | |
| MENDBackbone=Llama-3-8B-Instruct2026.05 | 36.19 | 36.19 | 24.31 | |
| ALPHAEDITBackbone=Qwen2.5-7B-Instruct2026.05 | 32.78 | 31.19 | 22.12 | |
| FTBackbone=Qwen2.5-7B-Instruct2026.05 | 26.09 | 24.62 | 21.36 | |
| FTBackbone=Mistral-7B-v0.32026.05 | 23.8 | 23.37 | 16.3 | |
| MALMENBackbone=Mistral-7B-v0.32026.05 | 18.42 | 17.43 | 12.09 | |
| FTBackbone=Llama-3-8B-Instruct2026.05 | 16.21 | 13.08 | 5.01 | |
| FTBackbone=GPT-J-6B2026.05 | 14.02 | 13.98 | 9.26 | |
| Pre-editedBackbone=GPT-J-6B2026.05 | 9.61 | 9.68 | 15.9 | |
| ALPHAEDITBackbone=Llama-3-8B-Instruct2026.05 | 6.39 | 6.14 | 2.72 | |
| MEMITBackbone=GPT-J-6B2026.05 | 5.54 | 5.03 | 5.46 | |
| ALPHAEDITBackbone=GPT-J-6B2026.05 | 1.89 | 1.87 | 1.85 | |
| MALMENBackbone=GPT-J-6B2026.05 | 1.33 | 1.25 | 2.92 | |
| Pre-editedBackbone=Qwen2.5-7B-Instruct2026.05 | 0.57 | 0.6 | 2.17 | |
| Pre-editedBackbone=Mistral-7B-v0.32026.05 | 0.41 | 0.5 | 1.98 | |
| MEMITBackbone=Qwen2.5-7B-Instruct2026.05 | 0.08 | 0.12 | 0.15 | |
| MALMENBackbone=Qwen2.5-7B-Instruct2026.05 | 0.06 | 0.06 | 0.07 | |
| Pre-editedBackbone=Llama-3-8B-Instruct2026.05 | 0.02 | 0.02 | 0.26 | |
| MEMITBackbone=Llama-3-8B-Instruct2026.05 | 0.02 | 0.02 | 0.02 | |
| MEMITBackbone=Mistral-7B-v0.32026.05 | 0 | 0 | 0 | |
| ALPHAEDITBackbone=Mistral-7B-v0.32026.05 | 0 | 0 | 0 | |
| MENDBackbone=Mistral-7B-v0.32026.05 | 0 | 0 | 0 |