Knowledge Modification on WikiBio
100Edit Success RateFT-M
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FT-MBackbone=Llama2-7b-chat2024.06 | 100 | 35.34 | 618.12 | 3.67 | — | |
| FT-MArchitecture=GPT2-xl2024.06 | 100 | 63.87 | 631.93 | 2.12 | — | |
| ICEArchitecture=GPT2-xl2024.06 | 100 | 63.67 | 629.6 | 2.22 | — | |
| ICEBackbone=Llama2-7b-chat2024.06 | 99.88 | 70.6 | 617.88 | 2.15 | — | |
| FT-MBackbone=Llama2-7b-chat2024.06 | 99.09 | 29.4 | 617.9 | 2.43 | — | |
| ICEBackbone=Llama2-7b-chat2024.06 | 99.09 | 30.17 | 612.66 | 1.95 | — | |
| ROMEBackbone=Llama2-7b-chat2024.06 | 95.83 | 68.38 | 617.67 | 3.7 | — | |
| MEMITBackbone=Llama2-7b-chat2024.06 | 94.54 | 69.96 | 616.65 | 3.51 | — | |
| ROMEArchitecture=GPT2-xl2024.06 | 81.52 | 27.49 | 633.41 | 2.11 | — | |
| FT-LBackbone=Llama2-7b-chat2024.06 | 59.41 | 28.94 | 615.5 | 1.89 | — | |
| MEMITArchitecture=GPT2-xl2024.06 | 57.31 | 39.65 | 632.89 | 1.87 | — | |
| FT-LArchitecture=GPT2-xl2024.06 | 51.59 | 66.66 | 626.17 | 1.16 | — | |
| FT-LBackbone=Llama2-7b-chat2024.06 | 38.02 | 13.2 | 595.31 | 1.07 | — | |
| MEMITBackbone=Llama2-7b-chat2024.06 | 26.49 | 3.73 | 599.4 | 586.35 | — | |
| ROMEBackbone=Llama2-7b-chat2024.06 | 8.31 | 4.34 | 497.42 | 1.12 | — |