Knowledge Editing on Knowledge Editing Edit (Test on German 1.0)
90.45ReliabilityReMaKE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKEBackbone=LLaMA, Shot setting=16-shot (Bilingual)2023.12 | 90.45 | 89.77 | 99.71 | 44.03 | |
| ReMaKEBackbone=LLaMA, Shot setting=Zero-shot2023.12 | 82.43 | 80.38 | 99.84 | 49.08 | |
| ReMaKEBackbone=BLOOMZ, Shot setting=16-shot (Bilingual)2023.12 | 74.47 | 73.21 | 99.63 | 19.55 | |
| IKEShot setting=Few-shot2023.12 | 74.16 | 73.94 | 38.6 | 38.48 | |
| ReMaKEBackbone=BLOOMZ, Shot setting=Zero-shot2023.12 | 57.23 | 56.05 | 99.63 | 20.21 | |
| ROME2023.12 | 43.56 | 41.83 | 95.99 | 5.61 | |
| SERAC2023.12 | 18.08 | 18.28 | 100 | 4.65 |