Knowledge Editing on MzsRE CS 1.0 (test)
75.1ReliabilityReMaKE-few-bi
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKE-few-biBackbone=LLaMA, Edit Language=EN2023.12 | 75.1 | 73.76 | 98.25 | 7.67 | |
| ReMaKE-zeroBackbone=LLaMA, Edit Language=EN2023.12 | 61.1 | 57.6 | 98.65 | 12.11 | |
| ReMaKE-few-monoBackbone=LLaMA, Edit Language=EN2023.12 | 56.26 | 55.59 | 98.38 | 6.46 | |
| IKEBackbone=LLaMA, Edit Language=EN2023.12 | 50.34 | 49.76 | 0.39 | 1.54 | |
| ROMEBackbone=LLaMA, Edit Language=EN2023.12 | 10.77 | 10.9 | 84.25 | 0 | |
| LLaMABackbone=LLaMA, Edit Language=EN2023.12 | 0.13 | 0.13 | — | 2.29 | |
| SERACBackbone=LLaMA, Edit Language=EN2023.12 | 0 | 0 | 100 | 0 |