Knowledge Editing on MzsRE TH (test)
3,244ReliabilityReMaKE-few-bi
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKE-few-biBackbone=LLaMA, Edit Language=EN2023.12 | 3,244 | 3,297 | 95.29 | 983 | |
| ReMaKE-zeroBackbone=LLaMA, Edit Language=EN2023.12 | 592 | 606 | 95.29 | 27 | |
| ReMaKE-few-monoBackbone=LLaMA, Edit Language=EN2023.12 | 565 | 552 | 95.29 | 13 | |
| IKEBackbone=LLaMA, Edit Language=EN2023.12 | 318 | 318 | 0.96 | 10 | |
| LLaMABackbone=LLaMA, Edit Language=EN2023.12 | 27 | 13 | — | 27 | |
| ROMEBackbone=LLaMA, Edit Language=EN2023.12 | 13 | 0 | 87.21 | 0 | |
| ReMaKE-few-biSetting=16-shot bilingual, Backbone=BLOOMZ, Edit Language=English2023.12 | 7.54 | 7.13 | 95.29 | 0.13 | |
| ReMaKE-zeroSetting=zero-shot, Backbone=BLOOMZ, Edit Language=English2023.12 | 4.44 | 4.71 | 95.29 | 0.13 | |
| BLOOMZStatus=Pre-editing, Backbone=BLOOMZ2023.12 | 0 | 0 | — | 0 | |
| SERACBackbone=LLaMA, Edit Language=EN2023.12 | 0 | 0 | 100 | 0 |