Knowledge Editing on Knowledge Editing Edit on English, Test on Czech 1.0 (CS)
87.61ReliabilityReMaKE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKEBackbone=LLaMA, Shot setting=16-shot (Bilingual)2023.12 | 87.61 | 87.02 | 98.97 | 42.89 | |
| ReMaKEBackbone=LLaMA, Shot setting=Zero-shot2023.12 | 79.91 | 78.03 | 99.15 | 45.38 | |
| IKEShot setting=Few-shot2023.12 | 74.62 | 73.85 | 32.71 | 35.51 | |
| ReMaKEBackbone=BLOOMZ, Shot setting=16-shot (Bilingual)2023.12 | 68.58 | 67.72 | 98.48 | 12.73 | |
| ReMaKEBackbone=BLOOMZ, Shot setting=Zero-shot2023.12 | 49.41 | 48.83 | 98.46 | 12.83 | |
| ROME2023.12 | 37 | 36.35 | 95.46 | 3.1 | |
| SERAC2023.12 | 19.38 | 19.14 | 100 | 2.52 |