Knowledge Editing on MzsRE Edit: Spanish, Test: EN
92.53ReliabilityReMaKE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKEBackbone=LLaMA, Protocol=few-shot (16 examples)2023.12 | 92.53 | 91.61 | 99.31 | 54.03 | |
| ReMaKEBackbone=LLaMA, Protocol=zero-shot2023.12 | 81.67 | 78.05 | 99.46 | 41.01 | |
| ReMaKEBackbone=BLOOMZ, Protocol=few-shot (16 examples)2023.12 | 75.91 | 74.72 | 98.77 | 36.7 | |
| IKE2023.12 | 67.62 | 66.57 | 35.37 | 38.64 | |
| ROME2023.12 | 64.7 | 63.24 | 96.16 | 5.03 | |
| ReMaKEBackbone=BLOOMZ, Protocol=zero-shot2023.12 | 60.77 | 59.88 | 99.48 | 0.57 | |
| ReMaKE-few-biBackbone=BLOOMZ, Mode=few-shot bilingual (16 examples)2023.12 | 52.89 | 51.68 | 98.38 | 10.9 | |
| ReMaKE-zeroBackbone=BLOOMZ, Mode=zero-shot2023.12 | 33.65 | 32.57 | 98.38 | 9.96 | |
| BLOOMZBackbone=BLOOMZ, Mode=pre-editing2023.12 | 1.88 | 1.35 | — | 6.59 |