Knowledge Editing on MzsRE Edit: Czech, Test: EN
94.59ReliabilityReMaKE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKEBackbone=LLaMA, Protocol=few-shot (16 examples)2023.12 | 94.59 | 94 | 99.25 | 55.25 | |
| ReMaKEBackbone=LLaMA, Protocol=zero-shot2023.12 | 81.11 | 78.57 | 99.51 | 39.8 | |
| ReMaKEBackbone=BLOOMZ, Protocol=few-shot (16 examples)2023.12 | 78.54 | 78.17 | 98.98 | 35.97 | |
| IKE2023.12 | 75.06 | 74.38 | 36.35 | 43.34 | |
| ROME2023.12 | 66.81 | 65.89 | 96.35 | 5.8 | |
| ReMaKEBackbone=BLOOMZ, Protocol=zero-shot2023.12 | 65.55 | 63.78 | 98.93 | 0.57 | |
| ReMaKE-few-biBackbone=BLOOMZ, Mode=few-shot bilingual (16 examples)2023.12 | 48.32 | 46.7 | 98.52 | 5.79 | |
| ReMaKE-zeroBackbone=BLOOMZ, Mode=zero-shot2023.12 | 34.05 | 32.44 | 98.52 | 9.02 | |
| BLOOMZBackbone=BLOOMZ, Mode=pre-editing2023.12 | 1.88 | 1.35 | — | 6.59 |