Knowledge Editing on MzsRE Edit: Turkish, Test: EN
91.14ReliabilityReMaKE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKEBackbone=LLaMA, Protocol=few-shot (16 examples)2023.12 | 91.14 | 90.7 | 99.46 | 53.67 | |
| ReMaKEBackbone=BLOOMZ, Protocol=few-shot (16 examples)2023.12 | 77.49 | 75.84 | 99.15 | 34.93 | |
| ReMaKEBackbone=LLaMA, Protocol=zero-shot2023.12 | 71.41 | 67.69 | 99.28 | 39.35 | |
| ReMaKEBackbone=BLOOMZ, Protocol=zero-shot2023.12 | 61.93 | 60.16 | 98.54 | 1.16 | |
| IKE2023.12 | 60.42 | 59.53 | 33.59 | 36.67 | |
| ReMaKE-few-biBackbone=BLOOMZ, Mode=few-shot bilingual (16 examples)2023.12 | 46.16 | 44.82 | 96.77 | 6.33 | |
| ROME2023.12 | 27.93 | 27.49 | 97.71 | 4.26 | |
| ReMaKE-zeroBackbone=BLOOMZ, Mode=zero-shot2023.12 | 27.86 | 25.84 | 96.64 | 7.54 | |
| BLOOMZBackbone=BLOOMZ, Mode=pre-editing2023.12 | 1.88 | 1.35 | — | 6.59 |