Knowledge Editing on FINE-KED GPT-J (test)
100EfficacyFT
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FTBackbone=GPT-J (6B)2025.05 | 100 | 69.2 | 64.8 | 60.6 | 65.9 | |
| ROMEBackbone=GPT-J (6B)2025.05 | 99.9 | 53.5 | 49.4 | 44.9 | 50.3 | |
| ROME-CBackbone=GPT-J (6B)2025.05 | 99.9 | 63.3 | 58.3 | 59.4 | 61 | |
| MEMITBackbone=GPT-J (6B)2025.05 | 99.9 | 61.9 | 56 | 59.5 | 59.7 | |
| AlphaEditBackbone=GPT-J (6B)2025.05 | 99.9 | 59.8 | 54.9 | 54.8 | 57.2 | |
| MEMIT-CBackbone=GPT-J (6B)2025.05 | 99.8 | 67.3 | 62.3 | 67.1 | 65.9 | |
| DiKEBackbone=GPT-J (6B)2025.05 | 99.1 | 72 | 67.4 | 74.1 | 71.3 | |
| MENDBackbone=GPT-J (6B)2025.05 | 98.7 | 71.7 | 66.5 | 51.8 | 65.4 | |
| BASEBackbone=GPT-J (6B)2025.05 | 21.7 | 86.9 | 87.6 | 89.2 | 87.6 |