Knowledge Editing on RIPPLEEDITS single-instance
100ReliabilityFT
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| FTModel=Llama-3-8B-Instruct, ChainEdit=w/ ours2025.07 | 100 | 65.5 | 47.2 | 97.4 | 60.2 | 36.5 | |
| LoRAModel=Llama-3-8B-Instruct, ChainEdit=w/o ours2025.07 | 100 | 23.7 | 41.7 | 99 | 45.6 | 28.1 | |
| FTModel=Qwen2.5-1.5B-Instruct, ChainEdit=w/ ours2025.07 | 100 | 55.6 | 43.9 | 97.9 | 36.3 | 27.1 | |
| FTModel=Qwen2.5-1.5B-Instruct, ChainEdit=w/o ours2025.07 | 100 | 16.5 | 43.5 | 98.6 | 42.6 | 31.7 | |
| LoRAModel=Qwen2.5-1.5B-Instruct, ChainEdit=w/ ours2025.07 | 100 | 59.6 | 49 | 99.1 | 33.6 | 24.1 | |
| LoRAModel=Qwen2.5-1.5B-Instruct, ChainEdit=w/o ours2025.07 | 100 | 17.6 | 39.5 | 99.1 | 29.1 | 19.4 | |
| LoRAModel=Llama-3-8B-Instruct, ChainEdit=w/ ours2025.07 | 99.9 | 65.7 | 51 | 97.8 | 48.2 | 33 | |
| MEMITModel=Llama-3-8B-Instruct, ChainEdit=w/o ours2025.07 | 99.8 | 18.6 | 34.3 | 75.7 | 38 | 31.2 | |
| MEMITModel=Qwen2.5-1.5B-Instruct, ChainEdit=w/o ours2025.07 | 99 | 22.1 | 24 | 59.7 | 40.6 | 30 | |
| MEMIT-MergeModel=Qwen2.5-1.5B-Instruct, ChainEdit=w/o ours2025.07 | 99 | 22.3 | 24.1 | 60.6 | 38.6 | 29.9 | |
| FTModel=Llama-3-8B-Instruct, ChainEdit=w/o ours2025.07 | 98.9 | 19.2 | 33.4 | 73.3 | 39.8 | 35.1 | |
| MEMIT-MergeModel=Llama-3-8B-Instruct, ChainEdit=w/o ours2025.07 | 98.8 | 19.3 | 33.2 | 73.2 | 40.1 | 35.3 | |
| MEMIT-MergeModel=Llama-3-8B-Instruct, ChainEdit=w/ ours2025.07 | 98.2 | 61.5 | 39.5 | 72.5 | 39.6 | 33 | |
| MEMIT-MergeModel=Qwen2.5-1.5B-Instruct, ChainEdit=w/ ours2025.07 | 96.6 | 61.5 | 29.5 | 59 | 35.8 | 29.4 | |
| MEMITModel=Llama-3-8B-Instruct, ChainEdit=w/ ours2025.07 | 90 | 58.7 | 37.4 | 65.8 | 41.9 | 37 | |
| MEMITModel=Qwen2.5-1.5B-Instruct, ChainEdit=w/ ours2025.07 | 87.4 | 55.8 | 26.2 | 53.3 | 41.1 | 35.1 |