Knowledge Editing on MzsRE NL (test)
7,268ReliabilityReMaKE-few-bi
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKE-few-biBackbone=LLaMA, Edit Language=EN2023.12 | 7,268 | 7,160 | 99.73 | 9.02 | |
| ReMaKE-zeroBackbone=LLaMA, Edit Language=EN2023.12 | 5,491 | 5,316 | 99.87 | 13.73 | |
| ReMaKE-few-monoBackbone=LLaMA, Edit Language=EN2023.12 | 4,993 | 4,859 | 99.73 | 9.69 | |
| ReMaKE-few-biSetting=16-shot bilingual, Backbone=BLOOMZ, Edit Language=English2023.12 | 4,468 | 4,307 | 99.73 | 108 | |
| IKEBackbone=LLaMA, Edit Language=EN2023.12 | 4,426 | 4,388 | 1.54 | 3.28 | |
| ReMaKE-zeroSetting=zero-shot, Backbone=BLOOMZ, Edit Language=English2023.12 | 2,826 | 2,759 | 99.73 | 94 | |
| ROMEBackbone=LLaMA, Edit Language=EN2023.12 | 1,548 | 1,196 | 87.08 | 0 | |
| LLaMABackbone=LLaMA, Edit Language=EN2023.12 | 27 | 40 | — | 2.83 | |
| BLOOMZStatus=Pre-editing, Backbone=BLOOMZ2023.12 | 13 | 13 | — | 13 | |
| SERACBackbone=LLaMA, Edit Language=EN2023.12 | 0 | 0 | 100 | 0 |