Knowledge Editing on MzsRE Edit: Thai, Test: EN
1,400ReliabilityReMaKE-few-bi
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKE-few-biBackbone=BLOOMZ, Mode=few-shot bilingual (16 examples)2023.12 | 1,400 | 1,373 | 9,731 | 498 | |
| ReMaKE-zeroBackbone=BLOOMZ, Mode=zero-shot2023.12 | 538 | 511 | 9,717 | 619 | |
| BLOOMZBackbone=BLOOMZ, Mode=pre-editing2023.12 | 188 | 135 | — | 659 | |
| ReMaKEBackbone=LLaMA, Protocol=few-shot (16 examples)2023.12 | 89.85 | 88.49 | 99.42 | 51.7 | |
| ReMaKEBackbone=BLOOMZ, Protocol=few-shot (16 examples)2023.12 | 71.65 | 69.98 | 98.82 | 54.61 | |
| ReMaKEBackbone=LLaMA, Protocol=zero-shot2023.12 | 70.14 | 67.9 | 98.87 | 37.3 | |
| IKE2023.12 | 64.38 | 63.24 | 35.49 | 36.81 | |
| ReMaKEBackbone=BLOOMZ, Protocol=zero-shot2023.12 | 54.48 | 52.4 | 98 | 1.29 | |
| ROME2023.12 | 37.05 | 36.75 | 97.66 | 0.77 |