Knowledge Editing on English Test Set 1.0
100ReliabilityIKE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| IKEShot setting=Few-shot2023.12 | 100 | 99.1 | 67.5 | 51.96 | |
| ReMaKEBackbone=LLaMA, Shot setting=16-shot (Bilingual)2023.12 | 100 | 99.07 | 99.76 | 62.27 | |
| ReMaKEBackbone=LLaMA, Shot setting=Zero-shot2023.12 | 98.05 | 92.48 | 99.76 | 64.07 | |
| SERAC2023.12 | 96.25 | 54.25 | 99.8 | 10.06 | |
| ReMaKEBackbone=BLOOMZ, Shot setting=16-shot (Bilingual)2023.12 | 91.43 | 87.16 | 99.39 | 37.63 | |
| ReMaKEBackbone=BLOOMZ, Shot setting=Zero-shot2023.12 | 89.69 | 85.02 | 99.5 | 44.06 | |
| ROME2023.12 | 83.8 | 68.91 | 97.83 | 9.28 |