Knowledge Editing on MzsRE (Edit: French, test: EN)
92.78ReliabilityReMaKE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKEBackbone=LLaMA, Protocol=few-shot (16 examples)2023.12 | 92.78 | 91.7 | 98.78 | 53.75 | |
| ReMaKEBackbone=LLaMA, Protocol=zero-shot2023.12 | 77.57 | 73.6 | 98.82 | 41.4 | |
| ReMaKEBackbone=BLOOMZ, Protocol=few-shot (16 examples)2023.12 | 75.19 | 75.78 | 98.09 | 35.65 | |
| IKE2023.12 | 66.74 | 65.6 | 36.7 | 41.45 | |
| ROME2023.12 | 65.76 | 61.57 | 95.6 | 5.72 | |
| ReMaKEBackbone=BLOOMZ, Protocol=zero-shot2023.12 | 59.46 | 58.18 | 98.69 | 0.85 | |
| ReMaKE-few-biBackbone=BLOOMZ, Mode=few-shot bilingual (16 examples)2023.12 | 48.86 | 48.18 | 98.38 | 7.81 | |
| ReMaKE-zeroBackbone=BLOOMZ, Mode=zero-shot2023.12 | 34.05 | 32.71 | 98.38 | 6.19 | |
| BLOOMZBackbone=BLOOMZ, Mode=pre-editing2023.12 | 1.88 | 1.35 | — | 6.59 |