Knowledge Editing Edit on English, Test on Russian 1.0 (RU)
84.28ReliabilityReMaKE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKEBackbone=LLaMA, Shot setting=16-shot (Bilingual)2023.12 | 84.28 | 83.74 | 98.14 | 44.64 | |
| ReMaKEBackbone=LLaMA, Shot setting=Zero-shot2023.12 | 67.37 | 65.04 | 98.49 | 44.39 | |
| IKEShot setting=Few-shot2023.12 | 55.83 | 55.11 | 34.88 | 39.55 | |
| ReMaKEBackbone=BLOOMZ, Shot setting=16-shot (Bilingual)2023.12 | 49.47 | 48.62 | 97.68 | 8.44 | |
| SERAC2023.12 | 19.91 | 19.61 | 100 | 4.31 | |
| ReMaKEBackbone=BLOOMZ, Shot setting=Zero-shot2023.12 | 19.91 | 19.77 | 97.91 | 6.14 | |
| ROME2023.12 | 18.1 | 17.82 | 95.72 | 4.32 |