Knowledge Unlearning on ZsRE
40.77EfficiencyROME
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ROMEModel=Llama-3.12026.05 | 40.77 | 38.93 | 31.72 | 7.48 | |
| BaseModel=Llama-3.12026.05 | 40.71 | 39.12 | 31.61 | 7.48 | |
| ROMEModel=Llama-3.12026.05 | 40.46 | 36.84 | 29.99 | 7.48 | |
| BaseModel=Llama-3.12026.05 | 40.42 | 36.84 | 29.87 | 7.47 | |
| MEMITModel=Llama-3.12026.05 | 35.15 | 34.6 | 30.05 | 7.48 | |
| MEMITModel=Llama-3.12026.05 | 34.6 | 34.24 | 31.49 | 7.63 | |
| AlphaEditModel=Llama-3.12026.05 | 34.12 | 34.19 | 29.93 | 7.48 | |
| BaseModel=Llama-3.22026.05 | 33.76 | 33.44 | 29.55 | 12.88 | |
| ROMEModel=Llama-3.22026.05 | 33.67 | 33.06 | 29.59 | 12.9 | |
| AlphaEditModel=Llama-3.12026.05 | 33.53 | 33.09 | 30.58 | 7.87 | |
| BaseModel=Llama-3.22026.05 | 32.82 | 32.23 | 28.12 | 12.88 | |
| ROMEModel=Llama-3.22026.05 | 32.8 | 32.17 | 28.05 | 12.89 | |
| ZeroUnlearnModel=Llama-3.12026.05 | 32.67 | 32.39 | 29.67 | 7.76 | |
| MEMITModel=Llama-3.22026.05 | 32.32 | 31.17 | 28.01 | 12.89 | |
| ROMEModel=Qwen-32026.05 | 31.5 | 31.25 | 29.14 | 11.25 | |
| BaseModel=Qwen-32026.05 | 31.44 | 31.08 | 28.98 | 11.21 | |
| ZeroUnlearn-GDModel=Llama-3.12026.05 | 31.44 | 31.5 | 29.6 | 8.2 | |
| FTModel=Llama-3.12026.05 | 31.36 | 30.91 | 26.99 | 8.16 | |
| ROMEModel=Qwen-32026.05 | 30.66 | 30.93 | 27.7 | 11.25 | |
| BaseModel=Qwen-32026.05 | 30.63 | 31.13 | 27.69 | 11.21 | |
| MEMITModel=Qwen-32026.05 | 30.33 | 30.07 | 28.62 | 11.29 | |
| MEMITModel=Llama-3.22026.05 | 29.78 | 29.6 | 29.16 | 13.01 | |
| AlphaEditModel=Llama-3.22026.05 | 29.59 | 29.9 | 27.8 | 12.88 | |
| MEMITModel=Qwen-32026.05 | 28.97 | 29.55 | 27.83 | 11.2 | |
| FTModel=Qwen-32026.05 | 28.89 | 27.8 | 27.98 | 11.97 | |
| FTModel=Llama-3.22026.05 | 28.83 | 27.7 | 26.8 | 13.24 | |
| AlphaEditModel=Qwen-32026.05 | 28.55 | 28.89 | 28.07 | 10.9 | |
| AlphaEditModel=Qwen-32026.05 | 28.52 | 28.29 | 27.82 | 11.2 | |
| ZeroUnlearn-GDModel=Qwen-32026.05 | 28.04 | 27.73 | 27.26 | 11.71 | |
| ZeroUnlearnModel=Llama-3.22026.05 | 27.85 | 27.52 | 27.73 | 13.08 | |
| AlphaEditModel=Llama-3.22026.05 | 27.66 | 27.54 | 28.04 | 13.25 | |
| ZeroUnlearnModel=Qwen-32026.05 | 25.35 | 25.53 | 27.28 | 10.96 | |
| ZeroUnlearn-GDModel=Llama-3.22026.05 | 25.29 | 25.22 | 25.32 | 13.6 | |
| FTModel=Llama-3.22026.05 | 25.13 | 24.52 | 24.62 | 15.57 | |
| FTModel=Qwen-32026.05 | 24.68 | 23.9 | 27.04 | 12.48 | |
| FTModel=Llama-3.12026.05 | 20.42 | 19.7 | 21.45 | 9.92 | |
| GAModel=Qwen-32026.05 | 3.17 | 2.81 | 7.1 | 1,000 | |
| GAModel=Llama-3.22026.05 | 1.41 | 1.16 | 3.53 | 1,000 | |
| GAModel=Llama-3.12026.05 | 0.27 | 0.27 | 0 | 1,000 | |
| GAModel=Llama-3.12026.05 | 0.1 | 0.11 | 1.08 | 1,000 | |
| GAModel=Qwen-32026.05 | 0.09 | 0.08 | 0.53 | 1,000 | |
| GAModel=Llama-3.22026.05 | 0 | 0 | 0.11 | 1,000 |