Knowledge Editing on UnKE
92.94Efficiency (Eff.)UltraEdit
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| UltraEditModel=Mistral-7B-v0.3, Number of instances=5002025.05 | 92.94 | 90.46 | 65.89 | 74.68 | 30.09 | |
| UltraEditModel=GPT-J, Number of instances=1,0002025.05 | 92.49 | 91.15 | 65.93 | 83.02 | 43.28 | |
| UltraEditModel=GPT-J, Number of instances=5002025.05 | 91.34 | 89.84 | 64.53 | 81.27 | 36.43 | |
| WISEModel=GPT-J, Number of instances=5002025.05 | 91.26 | 89.81 | 65.07 | 85.6 | 42.01 | |
| WISEModel=Mistral-7B-v0.3, Number of instances=5002025.05 | 89.77 | 88.78 | 70.68 | 79.61 | 35.64 | |
| RLEditModel=GPT-J, Number of instances=5002025.05 | 86.53 | 84.94 | 56.35 | 79.97 | 33.68 | |
| AlphaEditModel=Mistral-7B-v0.3, Number of instances=5002025.05 | 81.39 | 76.78 | 78.4 | 82.9 | 39.49 | |
| AlphaEditModel=GPT-J, Number of instances=5002025.05 | 75.96 | 63.2 | 77.19 | 78.83 | 35.6 | |
| FTModel=Mistral-7B-v0.3, Number of instances=5002025.05 | 70.87 | 70.43 | 70.85 | 70.95 | 13.39 | |
| UltraEditModel=Mistral-7B-v0.3, Number of instances=1,0002025.05 | 62.79 | 61.72 | 38.06 | 46.69 | 7.04 | |
| FTModel=GPT-J, Number of instances=5002025.05 | 46.93 | 46.49 | 50.49 | 51.02 | 11.85 | |
| RLEditModel=Mistral-7B-v0.3, Number of instances=5002025.05 | 46.63 | 44.35 | 15.29 | 33.8 | 6.93 |