Knowledge Editing (Edit on English, Test on Chinese) 1.0
80.23ReliabilityReMaKE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReMaKEBackbone=LLaMA, Shot setting=16-shot (Bilingual)2023.12 | 80.23 | 79.44 | 96.6 | 5,023 | |
| ReMaKEBackbone=BLOOMZ, Shot setting=16-shot (Bilingual)2023.12 | 70.08 | 68.63 | 96.43 | 4,247 | |
| ReMaKEBackbone=LLaMA, Shot setting=Zero-shot2023.12 | 68.53 | 66.36 | 97.17 | 4,775 | |
| ReMaKEBackbone=BLOOMZ, Shot setting=Zero-shot2023.12 | 55.64 | 53.82 | 96.53 | 4,319 | |
| IKEShot setting=Few-shot2023.12 | 42.25 | 42.11 | 45.65 | 2,383 | |
| ROME2023.12 | 11.18 | 10.66 | 97.8 | 73 | |
| SERAC2023.12 | 10.01 | 10.33 | 99.98 | 67 |