Knowledge Unlearning on FaithUn
91.92FSDefault
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DefaultModel=Llama-3.22025.09 | 91.92 | 89.22 | 57.4 | — | — | — | |
| DefaultModel=Qwen-2.52025.09 | 78.79 | 74.78 | 55.47 | — | — | — | |
| GAModel=Llama-3.22025.09 | 0 | 58.41 | 54.01 | 68.42 | 73.33 | 16.71 | |
| GDModel=Llama-3.22025.09 | 0 | 81.03 | 55.77 | 48.13 | 54.76 | 33.33 | |
| DPOModel=Llama-3.22025.09 | 0 | 81.47 | 56.9 | 31.58 | 46.67 | 15.34 | |
| NPOModel=Llama-3.22025.09 | 0 | 77.59 | 59.52 | 18.33 | 18.75 | 18.62 | |
| RMUModel=Llama-3.22025.09 | 0 | 77.8 | 56.31 | 52.63 | 75.53 | 14.29 | |
| KLUEModel=Llama-3.22025.09 | 0 | 81.68 | 56.72 | 57.14 | 62.96 | 28.33 | |
| SSIUUModel=Llama-3.22025.09 | 0 | 84.7 | 56.28 | 14.81 | 14.29 | 13.33 | |
| GAModel=Qwen-2.52025.09 | 0 | 36.21 | 53.55 | 52.63 | 66.67 | 63.64 | |
| GDModel=Qwen-2.52025.09 | 0 | 62.07 | 57.91 | 27.78 | 42.86 | 23.33 | |
| DPOModel=Qwen-2.52025.09 | 0 | 60.78 | 53.01 | 47.62 | 58.82 | 36.36 | |
| NPOModel=Qwen-2.52025.09 | 0 | 72.63 | 56.69 | 23.33 | 47.91 | 18.18 | |
| RMUModel=Qwen-2.52025.09 | 0 | 65.95 | 49.95 | 42.11 | 46.67 | 23.81 | |
| KLUEModel=Qwen-2.52025.09 | 0 | 62.5 | 56.94 | 33.33 | 47.92 | 22.73 | |
| SSIUUModel=Qwen-2.52025.09 | 0 | 75.86 | 60.01 | 4.76 | 29.41 | 13.04 |