Lifelong Knowledge Editing on COUNTERFACT
67.1ReliabilityEtCon
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| EtConBackbone=Llama-3-8B-Instruct2025.12 | 67.1 | 53.4 | 24.2 | 48.2 | |
| ALPHAEDITBackbone=Llama-3-8B-Instruct2025.12 | 61 | 43.8 | 16.1 | 40.3 | |
| EtConBackbone=Qwen2.5-7B-Instruct2025.12 | 59.6 | 43.2 | 29.7 | 44.2 | |
| FT-MBackbone=Llama-3-8B-Instruct2025.12 | 27.9 | 18.6 | 10.5 | 19 | |
| FT-MBackbone=Qwen2.5-7B-Instruct2025.12 | 3.2 | 3.1 | 24.4 | 10.2 | |
| GRACEBackbone=Llama-3-8B-Instruct2025.12 | 2.1 | 0.7 | 32.1 | 11.6 | |
| GRACEBackbone=Qwen2.5-7B-Instruct2025.12 | 1.9 | 1.2 | 36.8 | 13.3 | |
| WISEBackbone=Qwen2.5-7B-Instruct2025.12 | 1.4 | 1.5 | 31 | 11.3 | |
| WISEBackbone=Llama-3-8B-Instruct2025.12 | 1.3 | 0.8 | 31.3 | 11.1 | |
| Pre-editBackbone=Qwen2.5-7B-Instruct2025.12 | 1 | 0.5 | 36.9 | 12.8 | |
| Pre-editBackbone=Llama-3-8B-Instruct2025.12 | 0.6 | 0.8 | 31.8 | 11.1 | |
| MEMITBackbone=Llama-3-8B-Instruct2025.12 | 0.3 | 0.7 | 0.4 | 0.5 | |
| MEMITBackbone=Qwen2.5-7B-Instruct2025.12 | 0 | 0.2 | 0.1 | 0.1 | |
| ALPHAEDITBackbone=Qwen2.5-7B-Instruct2025.12 | 0 | 0 | 0 | 0 |