Knowledge Editing on MzsRE Edit: Dutch, Test: EN
92.38ReliabilityReMaKE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKEBackbone=LLaMA, Protocol=few-shot (16 examples)2023.12 | 92.38 | 91.23 | 99.35 | 53.68 | |
| ReMaKEBackbone=LLaMA, Protocol=zero-shot2023.12 | 78.63 | 73.05 | 99.36 | 40.49 | |
| ReMaKEBackbone=BLOOMZ, Protocol=few-shot (16 examples)2023.12 | 76.67 | 75.71 | 99 | 35.21 | |
| IKE2023.12 | 64.87 | 63.82 | 35.72 | 41.9 | |
| ROME2023.12 | 61.67 | 60.11 | 97.2 | 4.46 | |
| ReMaKEBackbone=BLOOMZ, Protocol=zero-shot2023.12 | 60.26 | 58.95 | 98.93 | 1.46 | |
| ReMaKE-few-biBackbone=BLOOMZ, Mode=few-shot bilingual (16 examples)2023.12 | 49.53 | 48.99 | 98.52 | 6.33 | |
| ReMaKE-zeroBackbone=BLOOMZ, Mode=zero-shot2023.12 | 30.55 | 28.8 | 98.52 | 9.69 | |
| BLOOMZBackbone=BLOOMZ, Mode=pre-editing2023.12 | 1.88 | 1.35 | — | 6.59 |