Knowledge Editing on MQuAKE-3K (test)
50.4168Overall M-Acc.MCircKE
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MCircKEModel=GPT-2 Large2026.04 | 50.4168 | 67.9306 | 38.6737 | 41.4723 | 64.915 | |
| MCircKE⋆Model=GPT-2 XL2026.04 | 49.3536 | 58.1423 | 39.7887 | 53.2468 | 77.446 | |
| MCircKEModel=GPT-2 XL2026.04 | 49.014 | 64.786 | 39.002 | 45.496 | 73.894 | |
| MCircKE⋆Model=GPT-2 Large2026.04 | 47.2824 | 54.1446 | 39.1432 | 49.2913 | 73.213 | |
| CaKEModel=GPT-2 XL2026.04 | 40.5246 | 46.6196 | 33.304 | 42.2954 | 76.659 | |
| CaKEModel=GPT-2 Large2026.04 | 34.9561 | 37.037 | 29.3721 | 40.4207 | 71.666 | |
| LoRAModel=GPT-2 XL2026.04 | 25.6085 | 41.9753 | 15.0528 | 16.5981 | 52.933 | |
| LoRAModel=GPT-2 Large2026.04 | 24.0858 | 39.3886 | 13.439 | 16.8724 | 48.947 | |
| ROMEModel=GPT-2 Large2026.04 | 14.9939 | 17.2546 | 13.1162 | 14.4033 | 52.956 | |
| ROMEModel=GPT-2 XL2026.04 | 12.5042 | 17.7543 | 9.8298 | 8.5048 | 61.511 | |
| AlphaEditModel=GPT-2 XL2026.04 | 9.4587 | 14.6972 | 6.0446 | 6.6301 | 48.749 | |
| AlphaEditModel=GPT-2 Large2026.04 | 8.5028 | 13.2275 | 5.6925 | 5.5327 | 44.093 | |
| MEMITModel=GPT-2 XL2026.04 | 8.4806 | 12.522 | 5.7218 | 6.4929 | 46.759 | |
| WISEModel=GPT-2 XL2026.04 | 8.3917 | 11.7578 | 5.7512 | 7.2702 | 22.876 | |
| WISEModel=GPT-2 Large2026.04 | 8.1138 | 11.699 | 5.9272 | 5.9442 | 21.421 | |
| MEMITModel=GPT-2 Large2026.04 | 7.7804 | 10.9053 | 5.7805 | 6.0357 | 35.009 |