Knowledge Modification on ZSRE (test)
100Edit Success RateFT-M
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FT-MBackbone=Llama2-7b-chat2024.06 | 100 | 54.47 | 53.84 | 580.1 | 27.33 | |
| ICEBackbone=Llama2-7b-chat2024.06 | 100 | 55.52 | 56.97 | 562.7 | 15.5 | |
| ROMEBackbone=Llama2-7b-chat2024.06 | 96.66 | 52.9 | 26.61 | 573.02 | 53.88 | |
| MEMITBackbone=Llama2-7b-chat2024.06 | 95.61 | 52.73 | 24.79 | 563.42 | 38.67 | |
| FT-LBackbone=Llama2-7b-chat2024.06 | 43.6 | 43.9 | 51.38 | 560.94 | 30.36 |