Machine Unlearning on TOFU World Fact 1.0
0.884ROUGE-LBase
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BaseBackbone=Dream-7B-Instruct2026.05 | 0.884 | 0.089 | — | |
| LoRABase Model=LLAMA2-7B-TOFU2024.10 | 0.88 | 0.46 | 0.6 | |
| MISTRAL-7B-TOFUModel Type=Base (No Unlearning)2024.10 | 0.88 | 0.62 | 0.78 | |
| LLAMA2-7B-TOFUModel Type=Base (No Unlearning)2024.10 | 0.87 | 0.43 | 0.56 | |
| LoRABase Model=MISTRAL-7B-TOFU2024.10 | 0.87 | 0.64 | 0.78 | |
| GABackbone=LLaDA-8B-Instruct2026.05 | 0.865 | 0.156 | — | |
| LLAMA2-13B-TOFUModel Type=Base (No Unlearning)2024.10 | 0.86 | 0.46 | 0.62 | |
| LoRABase Model=LLAMA2-13B-TOFU2024.10 | 0.86 | 0.48 | 0.63 | |
| CMCBase Model=MISTRAL-7B-TOFU2024.10 | 0.86 | 0.63 | 0.77 | |
| CMCBase Model=LLAMA2-7B-TOFU2024.10 | 0.85 | 0.45 | 0.57 | |
| MDUBackbone=LLaDA-8B-Instruct, τ=0.002026.05 | 0.848 | 0.193 | — | |
| GDBackbone=LLaDA-8B-Instruct2026.05 | 0.845 | 0.164 | — | |
| NPOBackbone=LLaDA-8B-Instruct2026.05 | 0.844 | 0.145 | — | |
| MDUBackbone=LLaDA-8B-Instruct, τ=0.252026.05 | 0.842 | 0.204 | — | |
| MDUBackbone=LLaDA-8B-Instruct, τ=0.502026.05 | 0.842 | 0.205 | — | |
| SimNPOBackbone=LLaDA-8B-Instruct2026.05 | 0.836 | 0.164 | — | |
| MDUBackbone=Dream-7B-Instruct, τ=0.002026.05 | 0.836 | 0.07 | — | |
| BaseBackbone=LLaDA-8B-Instruct2026.05 | 0.835 | 0.143 | — | |
| DPOBackbone=LLaDA-8B-Instruct2026.05 | 0.834 | 0.125 | — | |
| δ-UNLEARNINGBase Model=LLAMA2-13B-TOFU2024.10 | 0.83 | 0.41 | 0.59 | |
| CMCBase Model=LLAMA2-13B-TOFU2024.10 | 0.83 | 0.47 | 0.65 | |
| DPOBackbone=Dream-7B-Instruct2026.05 | 0.83 | 0.071 | — | |
| SimNPOBackbone=Dream-7B-Instruct2026.05 | 0.828 | 0.075 | — | |
| MDUBackbone=LLaDA-8B-Instruct, τ=0.752026.05 | 0.827 | 0.233 | — | |
| NPOBackbone=Dream-7B-Instruct2026.05 | 0.826 | 0.062 | — | |
| WGABackbone=Dream-7B-Instruct2026.05 | 0.825 | 0.062 | — | |
| WGABackbone=LLaDA-8B-Instruct2026.05 | 0.815 | 0.157 | — | |
| MDUBackbone=Dream-7B-Instruct, τ=0.252026.05 | 0.811 | 0.092 | — | |
| MDUBackbone=Dream-7B-Instruct, τ=0.502026.05 | 0.796 | 0.086 | — | |
| MDUBackbone=Dream-7B-Instruct, τ=1.002026.05 | 0.791 | 0.066 | — | |
| MDUBackbone=LLaDA-8B-Instruct, τ=1.002026.05 | 0.777 | 0.187 | — | |
| MDUBackbone=Dream-7B-Instruct, τ=0.752026.05 | 0.747 | 0.045 | — | |
| GDBackbone=Dream-7B-Instruct2026.05 | 0.719 | 0.077 | — | |
| GABackbone=Dream-7B-Instruct2026.05 | 0.343 | 0.019 | — |