Multi-hop Knowledge Editing on MQuAKE-3K
99.17Average PerformanceBase
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BaseTarget Model=Qwen3-8B, Setting=Few-shot2025.10 | 99.17 | 99.81 | 97.46 | 98.14 | 97.64 | — | — | — | — | — | — | — | — | — | — | |
| BaseTarget Model=GPT-J, Setting=Few-shot2025.10 | 98.42 | 99.7 | 95.48 | 97.51 | 97.23 | — | — | — | — | — | — | — | — | — | — | |
| ACE (AlphaEdit)Target Model=Qwen3-8B, Setting=Few-shot, Backbone Editor=AlphaEdit2025.10 | 61.54 | 62.48 | 64.76 | 63.04 | 51.32 | — | — | — | — | — | — | — | — | — | — | |
| ACE (PMET)Target Model=Qwen3-8B, Setting=Few-shot, Backbone Editor=PMET2025.10 | 58.24 | 60.22 | 59.48 | 51.62 | 47.61 | — | — | — | — | — | — | — | — | — | — | |
| ACE (AlphaEdit)Target Model=GPT-J, Setting=Few-shot, Backbone Editor=AlphaEdit2025.10 | 49.24 | 52.91 | 53.74 | 39.08 | 43.82 | — | — | — | — | — | — | — | — | — | — | |
| ACE (PMET)Target Model=GPT-J, Setting=Few-shot, Backbone Editor=PMET2025.10 | 46.45 | 45.26 | 50.24 | 36.17 | 43.29 | — | — | — | — | — | — | — | — | — | — | |
| AlphaEditTarget Model=Qwen3-8B, Setting=Few-shot2025.10 | 45.59 | 54.58 | 48.62 | 27.54 | 27.31 | — | — | — | — | — | — | — | — | — | — | |
| AlphaEditTarget Model=GPT-J, Setting=Few-shot2025.10 | 39.27 | 47.24 | 37.69 | 29.59 | 28.98 | — | — | — | — | — | — | — | — | — | — | |
| MEMITTarget Model=GPT-J, Setting=Few-shot2025.10 | 38.58 | 64.3 | 16.87 | 17.25 | 8.16 | — | — | — | — | — | — | — | — | — | — | |
| PMETTarget Model=GPT-J, Setting=Few-shot2025.10 | 37.01 | 49.26 | 36.3 | 24.34 | 17.01 | — | — | — | — | — | — | — | — | — | — | |
| ROMETarget Model=GPT-J, Setting=Few-shot2025.10 | 35.04 | 44.51 | 38.93 | 17.52 | 5.06 | — | — | — | — | — | — | — | — | — | — | |
| ROMETarget Model=Qwen3-8B, Setting=Few-shot2025.10 | 28.79 | 35.09 | 32.48 | 18.97 | 7.08 | — | — | — | — | — | — | — | — | — | — | |
| PMETTarget Model=Qwen3-8B, Setting=Few-shot2025.10 | 20.78 | 28.64 | 14.08 | 12.56 | 11.2 | — | — | — | — | — | — | — | — | — | — | |
| MEMITTarget Model=Qwen3-8B, Setting=Few-shot2025.10 | 18.67 | 29.84 | 19.18 | 12.91 | 4.2 | — | — | — | — | — | — | — | — | — | — | |
| FTTarget Model=GPT-J, Setting=Few-shot2025.10 | 3.54 | 4.17 | 2.63 | 0 | 0 | — | — | — | — | — | — | — | — | — | — | |
| FTTarget Model=Qwen3-8B, Setting=Few-shot2025.10 | 2.18 | 3.14 | 2.79 | 0 | 0 | — | — | — | — | — | — | — | — | — | — | |
| ACEfew-shot setting=true2025.10 | — | — | — | — | — | 46.45 | 58.24 | 45.26 | 50.24 | 36.17 | 43.29 | 60.22 | 59.48 | 51.62 | 47.61 | |
| Basefew-shot setting=true2025.10 | — | — | — | — | — | 98.42 | 99.17 | 99.7 | 95.48 | 97.51 | 97.23 | 99.81 | 97.46 | 98.14 | 97.64 | |
| FTfew-shot setting=true2025.10 | — | — | — | — | — | 3.54 | 2.18 | 4.17 | 2.63 | 0 | 0 | 3.14 | 2.79 | 0 | 0 | |
| MEMITfew-shot setting=true2025.10 | — | — | — | — | — | 38.58 | 18.67 | 64.3 | 16.87 | 17.25 | 8.16 | 29.84 | 19.18 | 12.91 | 4.2 | |
| PMETfew-shot setting=true2025.10 | — | — | — | — | — | 37.01 | 20.78 | 49.26 | 36.3 | 24.34 | 17.01 | 28.64 | 14.08 | 12.56 | 11.2 | |
| ROMEfew-shot setting=true2025.10 | — | — | — | — | — | 35.04 | 28.79 | 44.51 | 38.93 | 17.52 | 5.06 | 35.09 | 32.48 | 18.97 | 7.08 |