Knowledge Editing on EVOKE
53.1DPROME
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ROMEBackbone=GPT-J (6B)2025.06 | 53.1 | 1.9 | 6.1 | |
| ROMEBackbone=GPT2-XL (1.5B)2025.06 | 39.1 | 2.8 | 21.6 | |
| MEMITBackbone=GPT-J (6B)2025.06 | 38.8 | 2.2 | 12.3 | |
| AlphaEditBackbone=GPT-J (6B)2025.06 | 38.2 | 2.5 | 14.8 | |
| MEMITBackbone=GPT2-XL (1.5B)2025.06 | 38 | 1.9 | 10.9 | |
| AlphaEditBackbone=GPT2-XL (1.5B)2025.06 | 34.5 | 2.1 | 15.5 | |
| RETSBackbone=Qwen2.5 (14B)2025.06 | 33.8 | 7.9 | 29 | |
| RETSBackbone=GPT-J (6B)2025.06 | 30.1 | 4.2 | 30.7 | |
| AlphaEditBackbone=Qwen2.5 (7B)2025.06 | 20.8 | 8 | 33.6 | |
| ROMEBackbone=Qwen2.5 (14B)2025.06 | 18.1 | 9.4 | 45.3 | |
| ROME-LTIBackbone=GPT2-XL (1.5B)2025.06 | 17.7 | 3.6 | 31.4 | |
| MEMITBackbone=Qwen2.5 (14B)2025.06 | 16.9 | 15.3 | 48.9 | |
| ROMEBackbone=Qwen2.5 (7B)2025.06 | 16.6 | 9.3 | 42.6 | |
| ROME-LTIBackbone=Qwen2.5 (14B)2025.06 | 16.4 | 11.6 | 59.8 | |
| MEMITBackbone=Qwen2.5 (7B)2025.06 | 12.2 | 11.3 | 52.6 | |
| RETSBackbone=Qwen2.5 (7B)2025.06 | 10.2 | 14.1 | 70.5 | |
| ROME-LTIBackbone=GPT-J (6B)2025.06 | 9 | 3.5 | 32.5 | |
| ROME-CPABackbone=GPT-J (6B)2025.06 | 7.8 | 3.1 | 37.3 | |
| ROME-CPABackbone=Qwen2.5 (14B)2025.06 | 6.9 | 12.7 | 62.8 | |
| ROME-CPABackbone=GPT2-XL (1.5B)2025.06 | 5.7 | 2.5 | 36.5 | |
| RETSBackbone=GPT2-XL (1.5B)2025.06 | 5.2 | 4.8 | 61.4 | |
| ROME-LTIBackbone=Qwen2.5 (7B)2025.06 | 4.5 | 6.6 | 52.8 | |
| ROME-CPABackbone=Qwen2.5 (7B)2025.06 | 0.8 | 8.5 | 76.2 |