Knowledge Editing on MzsRE PT 1.0 (test)
7,120ReliabilityReMaKE-few-bi
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKE-few-biBackbone=LLaMA, Edit Language=EN2023.12 | 7,120 | 7,066 | 9,919 | 9.83 | |
| ReMaKE-zeroBackbone=LLaMA, Edit Language=EN2023.12 | 5,451 | 5,101 | 9,987 | 12.92 | |
| ReMaKE-few-monoBackbone=LLaMA, Edit Language=EN2023.12 | 4,549 | 4,468 | 9,919 | 10.23 | |
| IKEBackbone=LLaMA, Edit Language=EN2023.12 | 3,809 | 3,761 | 19 | 2.89 | |
| ROMEBackbone=LLaMA, Edit Language=EN2023.12 | 1,211 | 956 | 8,439 | 0 | |
| LLaMABackbone=LLaMA, Edit Language=EN2023.12 | 27 | 13 | — | 3.1 | |
| SERACBackbone=LLaMA, Edit Language=EN2023.12 | 0 | 0 | 10,000 | 0 |