Knowledge Editing on Multilingual Knowledge Editing EN LLaMA backbone (test)
90.17ReliabilityReMaKE-few-bi
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKE-few-biBackbone=LLaMA, Edit Language=German (DE), Context=16 bilingual examples2023.12 | 90.17 | 88.96 | 98.38 | 21.53 | |
| ReMaKE-few-biBackbone=LLaMA, Edit Language=Czech (CS), Context=16 bilingual examples2023.12 | 87.89 | 87.75 | 98.79 | 17.5 | |
| ReMaKE-few-biBackbone=LLaMA, Edit Language=Dutch (NL), Context=16 bilingual examples2023.12 | 87.21 | 86 | 98.79 | 19.92 | |
| ReMaKE-few-biBackbone=LLaMA, Edit Language=Portuguese (PT), Context=16 bilingual examples2023.12 | 86.68 | 85.6 | 98.92 | 19.11 | |
| ReMaKE-few-biBackbone=LLaMA, Edit Language=Spanish (ES), Context=16 bilingual examples2023.12 | 86.41 | 84.66 | 98.52 | 18.71 | |
| ReMaKE-few-biBackbone=LLaMA, Edit Language=French (FR), Context=16 bilingual examples2023.12 | 86.41 | 84.93 | 98.79 | 18.37 | |
| ReMaKE-few-biBackbone=LLaMA, Edit Language=Vietnamese (VI), Context=16 bilingual examples2023.12 | 84.66 | 84.25 | 98.79 | 17.77 | |
| ReMaKE-few-biBackbone=LLaMA, Edit Language=Russian (RU), Context=16 bilingual examples2023.12 | 82.91 | 82.1 | 97.98 | 19.25 | |
| ReMaKE-few-biBackbone=LLaMA, Edit Language=Turkish (TR), Context=16 bilingual examples2023.12 | 82.1 | 80.35 | 97.31 | 13.06 | |
| ReMaKE-few-biBackbone=LLaMA, Edit Language=Chinese (ZH), Context=16 bilingual examples2023.12 | 72.14 | 69.99 | 99.19 | 16.15 | |
| ReMaKE-zeroBackbone=LLaMA, Edit Language=Czech (CS), Setting=Zero-shot2023.12 | 69.18 | 63.26 | 98.92 | 25.71 | |
| ReMaKE-few-monoBackbone=LLaMA, Edit Language=Czech (CS), Context=16 monolingual examples2023.12 | 62.72 | 61.1 | 99.06 | 19.38 | |
| IKEBackbone=LLaMA, Edit Language=Czech (CS), Context=16 monolingual examples2023.12 | 57.67 | 56.41 | 1.25 | 5.69 | |
| ReMaKE-few-biBackbone=LLaMA, Edit Language=Thai (TH), Context=16 bilingual examples2023.12 | 49.26 | 48.99 | 97.17 | 13.19 | |
| ROMEBackbone=LLaMA, Edit Language=Czech (CS)2023.12 | 16.96 | 16.02 | 84.66 | 0 | |
| LLaMABackbone=LLaMA, Status=Pre-editing, Edit Language=Czech (CS)2023.12 | 1.08 | 0.94 | — | 8.48 |