Knowledge Editing on MzsRE Edit: Vietnamese, Test: EN
5,491ReliabilityReMaKE-few-bi
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKE-few-biBackbone=BLOOMZ, Mode=few-shot bilingual (16 examples)2023.12 | 5,491 | 5,249 | 98.52 | 740 | |
| ReMaKE-zeroBackbone=BLOOMZ, Mode=zero-shot2023.12 | 3,647 | 3,338 | 98.52 | 929 | |
| BLOOMZBackbone=BLOOMZ, Mode=pre-editing2023.12 | 188 | 135 | — | 659 | |
| ReMaKEBackbone=LLaMA, Protocol=few-shot (16 examples)2023.12 | 84.15 | 82.52 | 99.46 | 49.96 | |
| ReMaKEBackbone=BLOOMZ, Protocol=few-shot (16 examples)2023.12 | 71.07 | 68.8 | 98.6 | 49.87 | |
| ReMaKEBackbone=LLaMA, Protocol=zero-shot2023.12 | 67.56 | 63.53 | 99.59 | 38.04 | |
| ReMaKEBackbone=BLOOMZ, Protocol=zero-shot2023.12 | 49.76 | 47.51 | 98.6 | 0.85 | |
| IKE2023.12 | 42.94 | 43.34 | 36.13 | 32.5 | |
| ROME2023.12 | 13 | 12.74 | 95.19 | 0.45 |