List your company
ResearchFormerly WizWand

Knowledge Editing on Multilingual Knowledge Editing EN LLaMA backbone (test)

90.17ReliabilityReMaKE-few-bi
-2.483621.570745.62569.6793Dec 20, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ReMaKE-few-biBackbone=LLaMA, Edit Language=German (DE), Context=16 bilingual examples2023.1290.1788.9698.3821.53
ReMaKE-few-biBackbone=LLaMA, Edit Language=Czech (CS), Context=16 bilingual examples2023.1287.8987.7598.7917.5
ReMaKE-few-biBackbone=LLaMA, Edit Language=Dutch (NL), Context=16 bilingual examples2023.1287.218698.7919.92
ReMaKE-few-biBackbone=LLaMA, Edit Language=Portuguese (PT), Context=16 bilingual examples2023.1286.6885.698.9219.11
ReMaKE-few-biBackbone=LLaMA, Edit Language=Spanish (ES), Context=16 bilingual examples2023.1286.4184.6698.5218.71
ReMaKE-few-biBackbone=LLaMA, Edit Language=French (FR), Context=16 bilingual examples2023.1286.4184.9398.7918.37
ReMaKE-few-biBackbone=LLaMA, Edit Language=Vietnamese (VI), Context=16 bilingual examples2023.1284.6684.2598.7917.77
ReMaKE-few-biBackbone=LLaMA, Edit Language=Russian (RU), Context=16 bilingual examples2023.1282.9182.197.9819.25
ReMaKE-few-biBackbone=LLaMA, Edit Language=Turkish (TR), Context=16 bilingual examples2023.1282.180.3597.3113.06
ReMaKE-few-biBackbone=LLaMA, Edit Language=Chinese (ZH), Context=16 bilingual examples2023.1272.1469.9999.1916.15
ReMaKE-zeroBackbone=LLaMA, Edit Language=Czech (CS), Setting=Zero-shot2023.1269.1863.2698.9225.71
ReMaKE-few-monoBackbone=LLaMA, Edit Language=Czech (CS), Context=16 monolingual examples2023.1262.7261.199.0619.38
IKEBackbone=LLaMA, Edit Language=Czech (CS), Context=16 monolingual examples2023.1257.6756.411.255.69
ReMaKE-few-biBackbone=LLaMA, Edit Language=Thai (TH), Context=16 bilingual examples2023.1249.2648.9997.1713.19
ROMEBackbone=LLaMA, Edit Language=Czech (CS)2023.1216.9616.0284.660
LLaMABackbone=LLaMA, Status=Pre-editing, Edit Language=Czech (CS)2023.121.080.94—8.48