Knowledge Editing on MzsRE ZH 1.0 (test)
54.78ReliabilityReMaKE-few-bi
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKE-few-biBackbone=LLaMA, Edit Language=EN2023.12 | 54.78 | 53.57 | 93.94 | 5.25 | |
| ReMaKE-zeroBackbone=LLaMA, Edit Language=EN2023.12 | 25.44 | 23.01 | 94.48 | 3.5 | |
| ReMaKE-few-monoBackbone=LLaMA, Edit Language=EN2023.12 | 17.63 | 17.23 | 94.48 | 0.67 | |
| IKEBackbone=LLaMA, Edit Language=EN2023.12 | 6.36 | 5.98 | 0.96 | 0.1 | |
| LLaMABackbone=LLaMA, Edit Language=EN2023.12 | 1.21 | 1.48 | — | 1.08 | |
| ROMEBackbone=LLaMA, Edit Language=EN2023.12 | 1.21 | 0.81 | 91.92 | 0 | |
| SERACBackbone=LLaMA, Edit Language=EN2023.12 | 0 | 0 | 99.87 | 0 |