ResearchBenchmarksLifelong Knowledge Editing on GPT-J 1024 Edits (test)Follow14.6Score (S)WilKE-0.5843.3587.311.242Feb 16, 2024Evaluation ResultsMethodMethodLinksScore (S)Effectiveness (ES)Generality (PS)Locality (NS)Retention (ERS)Retention (ORS)WilKEBackbone=GPT-J (6B)Backbone=GPT-J (6B)2024.0214.671.350.67.419.18.5ROMEBackbone=GPT-J (6B)Backbone=GPT-J (6B)2024.028.728.720.74.610.95.8MENDBackbone=GPT-J (6B)Backbone=GPT-J (6B)2024.023.73.71.74.79.89.2MEMITBackbone=GPT-J (6B)Backbone=GPT-J (6B)2024.02032.123.89.300