Model Editing on Hallucination
8,183.7TRRDefer
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DeferBackbone=GPT2-XL2022.11 | 8,183.7 | 133.3 | 10.04 | 1,392 | 0.07 | |
| FT+RetrainBackbone=GPT2-XL2022.11 | 2,394.3 | 35.34 | 195.82 | 1,392 | 23.4 | |
| FT+EWCBackbone=GPT2-XL2022.11 | 1,485.7 | 29.24 | 109.59 | 1,392 | 0.29 | |
| FTBackbone=GPT2-XL2022.11 | 1,449.3 | 28.14 | 107.76 | 1,392 | 0.26 | |
| MENDBackbone=GPT2-XL2022.11 | 1,369.8 | 1,754.9 | 2,902.5 | 1,392 | 0.63 | |
| ROMEBackbone=GPT2-XL2022.11 | 30.28 | 103.82 | 14.02 | 1,392 | 0.64 | |
| MemoryBackbone=GPT2-XL2022.11 | 25.47 | 79.3 | 10.07 | 1,392 | 0.11 | |
| GRACEBackbone=GPT2-XL2022.11 | 15.84 | 7.14 | 10 | 1,392 | 0.13 |