Machine Unlearning on TOFU Forget 10%
65Aggregation ScoreRetrain
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| RetrainBackbone=Llama 3.2 3B2025.10 | 65 | 0.57 | 75 | — | — | — | |
| RetrainBackbone=Llama 3.1 8B2025.10 | 65 | 0.57 | 75 | — | — | — | |
| RetrainBackbone=Llama 3.2 1B2025.10 | 64 | 0.58 | 71 | — | — | — | |
| BS-SBackbone=Llama 3.1 8B2025.10 | 64 | 0.58 | 71 | — | — | — | |
| BS-SBackbone=Llama 3.2 3B2025.10 | 63 | 0.58 | 70 | — | — | — | |
| NPOBackbone=Llama 3.1 8B2025.10 | 63 | 0.57 | 70 | — | — | — | |
| BS-TBackbone=Llama 3.1 8B2025.10 | 63 | 0.57 | 70 | — | — | — | |
| NPOBackbone=Llama 3.2 3B2025.10 | 62 | 0.58 | 66 | — | — | — | |
| BS-TBackbone=Llama 3.2 3B2025.10 | 62 | 0.56 | 68 | — | — | — | |
| RMUBackbone=Llama 3.1 8B2025.10 | 62 | 0.55 | 72 | — | — | — | |
| BS-SBackbone=Llama 3.2 1B2025.10 | 61 | 0.59 | 63 | — | — | — | |
| BS-TBackbone=Llama 3.2 1B2025.10 | 59 | 0.56 | 62 | — | — | — | |
| NPOBackbone=Llama 3.2 1B2025.10 | 58 | 0.58 | 58 | — | — | — | |
| RMUBackbone=Llama 3.2 1B2025.10 | 58 | 0.59 | 57 | — | — | — | |
| RMUBackbone=Llama 3.2 3B2025.10 | 55 | 0.44 | 74 | — | — | — | |
| WGABackbone=Llama 3.2 1B2025.10 | 53 | 0.47 | 62 | — | — | — | |
| GradDiffBackbone=Llama 3.2 1B2025.10 | 52 | 0.49 | 56 | — | — | — | |
| WGABackbone=Llama 3.1 8B2025.10 | 52 | 0.41 | 70 | — | — | — | |
| WGABackbone=Llama 3.2 3B2025.10 | 51 | 0.42 | 66 | — | — | — | |
| GradDiffBackbone=Llama 3.1 8B2025.10 | 50 | 0.45 | 55 | — | — | — | |
| GradDiffBackbone=Llama 3.2 3B2025.10 | 49 | 0.47 | 52 | — | — | — | |
| SimNPOBackbone=Llama 3.2 1B2025.10 | 47 | 0.35 | 70 | — | — | — | |
| SimNPOBackbone=Llama 3.2 3B2025.10 | 41 | 0.28 | 74 | — | — | — | |
| SimNPOBackbone=Llama 3.1 8B2025.10 | 29 | 0.18 | 72 | — | — | — | |
| OriginalBackbone=Llama 3.2 1B2025.10 | 16 | 0.09 | 71 | — | — | — | |
| EUABackbone=LLaMA-3.2-3B2026.05 | 8.665 | — | — | 9.478 | 7.784 | 8.651 | |
| EUABackbone=Qwen2.5-7B2026.05 | 8.665 | — | — | 9.563 | 7.416 | 8.878 | |
| EUABackbone=LLaMA-3.1-8B2026.05 | 8.598 | — | — | 9.55 | 7.433 | 8.679 | |
| EUABackbone=Qwen2.5-3B2026.05 | 8.561 | — | — | 9.528 | 7.332 | 8.619 | |
| EUABackbone=LLaMA-3.2-1B2026.05 | 8.32 | — | — | 9.317 | 6.694 | 8.72 | |
| EUABackbone=Qwen2.5-1.5B2026.05 | 8.264 | — | — | 9.189 | 6.821 | 8.597 | |
| DPOBackbone=LLaMA-3.2-3B2026.05 | 6.967 | — | — | 5.937 | 7.319 | 7.536 | |
| DPOBackbone=LLaMA-3.2-1B2026.05 | 6.816 | — | — | 6.414 | 6.378 | 7.587 | |
| DPOBackbone=LLaMA-3.1-8B2026.05 | 6.758 | — | — | 6.116 | 6.827 | 7.281 | |
| WGABackbone=LLaMA-3.2-3B2026.05 | 6.71 | — | — | 8.711 | 7.684 | 0.371 | |
| SimNPOBackbone=Qwen2.5-3B2026.05 | 6.501 | — | — | 6.612 | 6.786 | 6.084 | |
| SatImpBackbone=LLaMA-3.2-3B2026.05 | 6.484 | — | — | 8.175 | 7.676 | 0.6 | |
| DPOBackbone=Qwen2.5-7B2026.05 | 6.445 | — | — | 5.503 | 5.673 | 7.885 | |
| SimNPOBackbone=Qwen2.5-7B2026.05 | 6.397 | — | — | 6.857 | 7.225 | 4.853 | |
| SimNPOBackbone=LLaMA-3.2-1B2026.05 | 6.32 | — | — | 7.244 | 6.521 | 4.983 | |
| WGABackbone=Qwen2.5-1.5B2026.05 | 6.182 | — | — | 7.267 | 6.282 | 4.729 | |
| SimNPOBackbone=Qwen2.5-1.5B2026.05 | 6.165 | — | — | 5.867 | 6.525 | 6.086 | |
| SimNPOBackbone=LLaMA-3.1-8B2026.05 | 6.152 | — | — | 7.232 | 6.996 | 3.508 | |
| RMUBackbone=LLaMA-3.2-1B2026.05 | 6.149 | — | — | 8.917 | 5.823 | 0.135 | |
| SimNPOBackbone=LLaMA-3.2-3B2026.05 | 6.144 | — | — | 6.984 | 7.232 | 3.49 | |
| RMUBackbone=LLaMA-3.2-3B2026.05 | 6.129 | — | — | 7.769 | 7.228 | 0.291 | |
| WGABackbone=Qwen2.5-7B2026.05 | 6.071 | — | — | 7.804 | 7.004 | 0.781 | |
| DPOBackbone=Qwen2.5-3B2026.05 | 6.009 | — | — | 2.66 | 6.59 | 7.605 | |
| SatImpBackbone=Qwen2.5-7B2026.05 | 6.005 | — | — | 6.628 | 7.004 | 3.898 | |
| OriginalBackbone=Llama 3.2 3B2025.10 | 6 | 0.03 | 75 | — | — | — | |
| WGABackbone=Qwen2.5-3B2026.05 | 5.93 | — | — | 7.518 | 6.942 | 0.884 | |
| SatImpBackbone=LLaMA-3.1-8B2026.05 | 5.917 | — | — | 7.048 | 6.684 | 3.271 | |
| SatImpBackbone=Qwen2.5-3B2026.05 | 5.898 | — | — | 7.65 | 6.725 | 0.794 | |
| RMUBackbone=Qwen2.5-7B2026.05 | 5.853 | — | — | 7.498 | 6.699 | 1.289 | |
| RMUBackbone=Qwen2.5-3B2026.05 | 5.844 | — | — | 7.613 | 6.654 | 0.474 | |
| WGABackbone=LLaMA-3.1-8B2026.05 | 5.822 | — | — | 7.338 | 6.883 | 0.68 | |
| OriginalBackbone=LLaMA-3.2-3B2026.05 | 5.809 | — | — | 0.158 | 7.881 | 6.253 | |
| DPOBackbone=Qwen2.5-1.5B2026.05 | 5.766 | — | — | 3.175 | 5.716 | 7.549 | |
| NPOBackbone=Qwen2.5-7B2026.05 | 5.718 | — | — | 6.957 | 6.708 | 2.169 | |
| NPOBackbone=LLaMA-3.2-3B2026.05 | 5.65 | — | — | 6.952 | 5.322 | 4.372 | |
| SatImpBackbone=Qwen2.5-1.5B2026.05 | 5.646 | — | — | 7.415 | 6.346 | 0.611 | |
| RMUBackbone=LLaMA-3.1-8B2026.05 | 5.579 | — | — | 6.947 | 6.711 | 0.258 | |
| OriginalBackbone=LLaMA-3.1-8B2026.05 | 5.578 | — | — | 0.073 | 7.456 | 6.144 | |
| WGABackbone=LLaMA-3.2-1B2026.05 | 5.526 | — | — | 7.56 | 5.83 | 0.672 | |
| OriginalBackbone=Qwen2.5-3B2026.05 | 5.473 | — | — | 0.234 | 7.366 | 5.961 | |
| OriginalBackbone=Qwen2.5-7B2026.05 | 5.473 | — | — | 0.152 | 7.476 | 5.825 | |
| SatImpBackbone=LLaMA-3.2-1B2026.05 | 5.468 | — | — | 6.984 | 6.346 | 0.798 | |
| NPOBackbone=LLaMA-3.1-8B2026.05 | 5.437 | — | — | 6.629 | 6.612 | 1.006 | |
| RMUBackbone=Qwen2.5-1.5B2026.05 | 5.403 | — | — | 6.986 | 6.226 | 0.082 | |
| NPOBackbone=Qwen2.5-3B2026.05 | 5.378 | — | — | 7.08 | 4.069 | 4.484 | |
| NPOBackbone=Qwen2.5-1.5B2026.05 | 5.34 | — | — | 6.319 | 4.444 | 5.087 | |
| NPOBackbone=LLaMA-3.2-1B2026.05 | 5.333 | — | — | 6.8 | 4.386 | 4.452 | |
| GradDiffBackbone=Qwen2.5-3B2026.05 | 5.208 | — | — | 8.497 | 3.011 | 0.329 | |
| OriginalBackbone=LLaMA-3.2-1B2026.05 | 5.161 | — | — | 0.3 | 7.37 | 5.049 | |
| GradDiffBackbone=Qwen2.5-1.5B2026.05 | 5.159 | — | — | 8.196 | 3.551 | 0.232 | |
| GradDiffBackbone=LLaMA-3.1-8B2026.05 | 5.092 | — | — | 6.991 | 5.361 | 0.385 | |
| OriginalBackbone=Qwen2.5-1.5B2026.05 | 5.048 | — | — | 0.516 | 6.843 | 5.418 | |
| GradDiffBackbone=LLaMA-3.2-1B2026.05 | 4.997 | — | — | 8.318 | 2.385 | 0.23 | |
| GradDiffBackbone=Qwen2.5-7B2026.05 | 4.91 | — | — | 8.027 | 2.81 | 0.031 | |
| GradDiffBackbone=LLaMA-3.2-3B2026.05 | 4.601 | — | — | 7.571 | 2.487 | 0.049 | |
| OriginalBackbone=Llama 3.1 8B2025.10 | 2 | 0.01 | 73 | — | — | — |