Knowledge Editing on MzsRE VI (test)
6,837ReliabilityReMaKE-few-bi
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKE-few-biBackbone=LLaMA, Edit Language=EN2023.12 | 6,837 | 6,783 | 97.71 | 2.42 | |
| ReMaKE-zeroBackbone=LLaMA, Edit Language=EN2023.12 | 4,832 | 4,603 | 97.71 | 5.79 | |
| ReMaKE-few-biSetting=16-shot bilingual, Backbone=BLOOMZ, Edit Language=English2023.12 | 4,630 | 4,401 | 97.44 | 2.83 | |
| ReMaKE-few-monoBackbone=LLaMA, Edit Language=EN2023.12 | 4,172 | 4,118 | 97.71 | 3.5 | |
| IKEBackbone=LLaMA, Edit Language=EN2023.12 | 4,002 | 3,934 | 0.96 | 1.74 | |
| ReMaKE-zeroSetting=zero-shot, Backbone=BLOOMZ, Edit Language=English2023.12 | 2,880 | 2,705 | 97.44 | 3.77 | |
| ROMEBackbone=LLaMA, Edit Language=EN2023.12 | 431 | 417 | 91.92 | 0 | |
| BLOOMZStatus=Pre-editing, Backbone=BLOOMZ2023.12 | 40 | 27 | — | 2.29 | |
| LLaMABackbone=LLaMA, Edit Language=EN2023.12 | 13 | 13 | — | 1.88 | |
| SERACBackbone=LLaMA, Edit Language=EN2023.12 | 0 | 0 | 100 | 0 |