Machine Unlearning on 5% Forget Set
193.398GFKLM
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| KLMModel=Mistral-7B2026.01 | 193.398 | 209.753 | 0.01 | 0 | -1.001 | -1.001 | 0.034 | 11.2 | 0.068 | 124.738 | 74.003 | 0.016 | -0.907 | |
| GAModel=Mistral-7B2026.01 | 154.695 | 202.52 | 0.013 | 0 | -0.995 | -0.995 | 0.034 | 11.2 | 0.068 | 124.738 | 74.003 | 0.016 | -0.899 | |
| GAModel=Llama2-7B2026.01 | 104.73 | 110.11 | 0.019 | 0 | -0.805 | -0.805 | 0.007 | 16.7 | 0.014 | 83.887 | 49.734 | 0.024 | -0.748 | |
| KLMModel=Llama2-7B2026.01 | 104.73 | 110.11 | 0.019 | 0 | -0.808 | -0.808 | 0.007 | 16.7 | 0.014 | 83.887 | 49.734 | 0.024 | -0.751 | |
| GAModel=OLMOE2026.01 | 84.662 | 87.404 | 0.024 | 0 | -3.189 | -3.189 | 0.006 | 6.8 | 0.012 | 65.839 | 71.628 | 0.03 | -3.123 | |
| KLMModel=OLMOE2026.01 | 84.662 | 87.404 | 0.024 | 0 | -3.179 | -3.179 | 0.006 | 7.7 | 0.012 | 65.839 | 71.628 | 0.03 | -3.113 | |
| GAModel=Llama-13B2026.01 | 62.572 | 75.388 | 0.032 | 0 | -0.362 | -0.362 | 0.002 | 16.4 | 0.004 | 15.695 | 27.613 | 0.127 | -0.199 | |
| KLMModel=Llama-13B2026.01 | 61.507 | 72.625 | 0.033 | 0 | -1.002 | -1.002 | 0.001 | 16.4 | 0.002 | 26.829 | 26.125 | 0.074 | -0.893 | |
| NPOModel=Llama2-7B2026.01 | 39.85 | 37.772 | 0.05 | 0 | 0.92 | 0.92 | 0.001 | 3.1 | 0.002 | 32.027 | 17.946 | 0.062 | 1.034 | |
| DPOModel=Mistral-7B2026.01 | 27.66 | 25.787 | 0.072 | 0 | -0.554 | -0.554 | 0.006 | 9.9 | 0.012 | 17.218 | 9.888 | 0.115 | -0.355 | |
| GDModel=Mistral-7B2026.01 | 18.287 | 17.198 | 0.109 | 0.943 | -0.511 | 0.432 | 0.363 | 37.5 | 0.639 | 1.258 | 1.551 | 1.051 | 2.232 | |
| NPOModel=Mistral-7B2026.01 | 9.549 | 7.433 | 0.207 | 0 | 0.996 | 0.996 | 0.001 | 14.6 | 0.001 | 9.595 | 3.561 | 0.203 | 1.406 | |
| NPOModel=Llama-13B2026.01 | 6.958 | 11.82 | 0.284 | 0.472 | 1.115 | 0.356 | 0.747 | 34.5 | 1.188 | 2.02 | 3.213 | 0.858 | 2.686 | |
| GDModel=OLMOE2026.01 | 6.214 | 9.374 | 0.316 | 1.202 | -1.924 | -0.722 | 0.054 | 8.1 | 0.108 | 4.901 | 8.573 | 0.399 | 0.101 | |
| GDModel=Llama2-7B2026.01 | 4.597 | 6.006 | 0.42 | 0.497 | 0.054 | 0.551 | 0.21 | 24.5 | 0.399 | 4.811 | 3.988 | 0.395 | 1.765 | |
| DPOModel=Llama2-7B2026.01 | 4.082 | 6.78 | 0.473 | 0 | -0.998 | -0.998 | 0.042 | 22.5 | 0.083 | 5.043 | 5.312 | 0.382 | -0.06 | |
| DPOModel=OLMOE2026.01 | 1.887 | -0.2 | -0.645 | 0 | -0.953 | -0.953 | 0.705 | 56 | 1.011 | 1.929 | 0.831 | 0.638 | 0.051 | |
| NSPUModel=Llama2-7B2026.01 | 1.388 | 2.055 | 1.067 | 1.021 | 0.498 | 1.519 | 0.581 | 70.5 | 0.824 | 2.59 | 2.331 | 0.662 | 4.073 | |
| NSPUModel=Llama-13B2026.01 | 1.173 | 1.445 | 1.072 | 0.987 | 0.736 | 1.723 | 0.817 | 51.8 | 1.148 | 1.48 | 1.535 | 0.938 | 4.882 | |
| NSPUModel=OLMOE2026.01 | 0.631 | 2.008 | 1.771 | 2.98 | 1.548 | 4.528 | 0.857 | 40.8 | 1.27 | 1.415 | 2.483 | 1.1 | 8.669 | |
| NPOModel=OLMOE2026.01 | 0.095 | 0.318 | 0.617 | 1.025 | 1.156 | 2.181 | 1.007 | 73 | 1.16 | 0.703 | 0.636 | 0.879 | 4.837 | |
| GDModel=Llama-13B2026.01 | 0.067 | 0.077 | 0.154 | 0.598 | 0.762 | 1.36 | 0.765 | 145.4 | 0.724 | 1.329 | 0.977 | 0.85 | 3.088 | |
| DPOModel=Llama-13B2026.01 | 0.065 | 0.115 | 0.228 | 0.454 | 0.71 | 1.164 | 0.651 | 66.4 | 0.909 | 1.737 | 1.367 | 0.81 | 3.111 | |
| NSPUModel=Mistral-7B2026.01 | -0.084 | 2.066 | 4.995 | 0.921 | -0.536 | 0.385 | 0.876 | 54.2 | 1.188 | 0.955 | 1.65 | 1.281 | 7.849 |