Knowledge Editing on ZsRE 500 edits Sequential (test)
100EfficiencyGRACE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| GRACEModel=GPT2024.10 | 100 | 0.15 | 100 | 66.72 | |
| GRACEModel=Llama2024.10 | 98.87 | 0.59 | 99.72 | 66.39 | |
| D4SModel=GPT2024.10 | 97.42 | 93.12 | 74.65 | 88.4 | |
| D4SModel=Llama2024.10 | 91.19 | 81.48 | 83.34 | 85.34 | |
| MEMITModel=GPT2024.10 | 84.94 | 76.15 | 73.6 | 73.6 | |
| ROMEModel=Llama2024.10 | 48.68 | 47.72 | 32.56 | 42.99 | |
| FTModel=Llama2024.10 | 19.43 | 18.06 | 6.56 | 14.68 | |
| FTModel=GPT2024.10 | 12.95 | 7.84 | 0.23 | 7.01 | |
| MEMITModel=Llama2024.10 | 2.9 | 2.9 | 2.51 | 2.77 | |
| ROMEModel=GPT2024.10 | 2.67 | 1.83 | 1.55 | 2.02 | |
| PMETModel=Llama2024.10 | 0 | 0 | 0 | 0 | |
| PMETModel=GPT2024.10 | 0 | 0 | 0 | 0 |